Jul 10 19:29:19 devstack cinder-volume[75905]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 19:29:19 devstack cinder-volume[75905]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 19:29:19 devstack cinder-volume[75905]: we strongly recommend against using it for new projects. Jul 10 19:29:19 devstack cinder-volume[75905]: If you are already using Eventlet, we recommend migrating to a different Jul 10 19:29:19 devstack cinder-volume[75905]: framework. For more detail see Jul 10 19:29:19 devstack cinder-volume[75905]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 19:29:19 devstack cinder-volume[75905]: import eventlet # noqa Jul 10 19:29:22 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:29:22 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:29:22 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:29:23 devstack cinder-volume[75905]: INFO dbcounter [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Registered counter for database cinder Jul 10 19:29:23 devstack cinder-volume[75905]: DEBUG oslo_db.sqlalchemy.engines [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:29:23 devstack cinder-volume[75905]: DEBUG dbcounter [-] [75905] Writer thread running {{(pid=75905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 19:29:23 devstack cinder-volume[75905]: INFO cinder.rpc [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 19:29:23 devstack cinder-volume[75905]: INFO cinder.rpc [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 19:29:23 devstack cinder-volume[75905]: DEBUG oslo_db.sqlalchemy.engines [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:29:23 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Determined volume DB was empty at startup. Jul 10 19:29:23 devstack cinder-volume[75905]: DEBUG cinder.volume.manager [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75905) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 19:29:23 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 19:29:23 devstack cinder-volume[75905]: WARNING stevedore.named [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 19:29:23 devstack cinder-volume[75905]: WARNING castellan.key_manager [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:29:23 devstack cinder-volume[75905]: WARNING cinder.keymgr.conf_key_mgr [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:29:23 devstack cinder-volume[75905]: DEBUG cinder.volume.drivers.lvm [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75905) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 19:29:23 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_concurrency.processutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] CMD "cinder-rtstool verify" returned: 0 in 0.543s {{(pid=75905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_db.sqlalchemy.engines [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:29:24 devstack cinder-volume[75905]: INFO cinder.rpc [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 19:29:24 devstack cinder-volume[75905]: INFO cinder.rpc [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 19:29:24 devstack cinder-volume[75905]: WARNING stevedore.named [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 19:29:24 devstack cinder-volume[75905]: WARNING castellan.key_manager [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:29:24 devstack cinder-volume[75905]: INFO cinder.volume.manager [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_db.sqlalchemy.engines [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:29:24 devstack cinder-volume[75905]: INFO oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Starting 1 workers Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Started child 76074 {{(pid=75905) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Full set of CONF: {{(pid=75905) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] ******************************************************************************** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Configuration options gathered from: {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] ================================================================================ {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 19:29:24 devstack cinder-volume[76074]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] allow_availability_zone_fallback = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] allow_compression_on_image_upload = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] allowed_direct_url_schemes = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] api_rate_limit = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] auth_strategy = keystone {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] az_cache_duration = 3600 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_availability_zone = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_host = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_stats_polling_interval = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backup_api_class = cinder.backup.api.API {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backup_name_template = backup-%s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backup_use_same_host = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backup_use_temp_snapshot = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] chap_password = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] chap_username = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_internal_tenant_project_id = 9c403ce7fdde414eaadf8f6e3b4a3610 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_internal_tenant_user_id = aa7e38cefbc948f8a31e1ae23d04463f {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cloned_volume_same_az = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cluster = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] compression_format = gzip {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] compute_api_class = cinder.compute.nova.API {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] config_dir = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] config_source = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] control_exchange = openstack {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] debug = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] default_availability_zone = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] default_group_type = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] default_volume_type = lvmdriver-1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] disk_geometry = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] driver_client_cert = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] driver_client_cert_key = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] driver_data_namespace = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] driver_ssl_cert_path = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] driver_ssl_cert_verify = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] driver_use_ssl = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] enable_force_upload = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] enable_new_services = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] enable_unsupported_driver = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] enforce_multipath_for_image_xfer = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] filter_function = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_api_insecure = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_api_ssl_compression = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_ca_certificates_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_catalog_info = image:glance:publicURL {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_num_retries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance_request_timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] goodness_function = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] graceful_shutdown_timeout = 5 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] group_api_class = cinder.group.api.API {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] host = devstack {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_compress_on_upload = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_conversion_address_space_limit = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_conversion_cpu_limit = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_conversion_disable = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_upload_use_cinder_backend = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_upload_use_internal_tenant = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_volume_cache_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_volume_cache_max_count = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] image_volume_cache_max_size_gb = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] init_host_max_objects_retrieval = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] instance_format = [instance: %(uuid)s] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] iscsi_target_flags = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] iscsi_write_cache = on {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] iser_helper = tgtadm {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] iser_ip_address = 192.168.122.71 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] iser_port = 3260 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_color = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_config_append = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_dir = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_options = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_rotate_interval = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_rotate_interval_type = days {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] log_rotation_type = none {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] max_age = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] max_logfile_count = 30 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] max_logfile_size_mb = 200 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] max_over_subscription_ratio = 20.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] message_reap_interval = 86400 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] message_ttl = 2592000 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] migration_create_volume_timeout_secs = 300 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] monkey_patch = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] monkey_patch_modules = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] my_ip = 192.168.122.71 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] no_snapshot_gb_quota = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] num_iser_scan_tries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] num_shell_tries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] num_volume_device_scan_tries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] nvmeof_conn_info_version = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] nvmet_ns_id = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] nvmet_port_id = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_max_limit = 1000 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_volume_ext_list = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_volume_listen_port = 8776 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_volume_use_ssl = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] osapi_volume_workers = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] per_volume_size_limit = -1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] periodic_fuzzy_delay = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] periodic_interval = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] public_endpoint = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] publish_errors = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_backup_gigabytes = 1000 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_backups = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_gigabytes = 1000 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_groups = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_snapshots = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] quota_volumes = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] rate_limit_burst = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] rate_limit_except_level = CRITICAL {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] rate_limit_interval = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] reinit_driver_count = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] replication_device = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] report_discard_supported = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] report_interval = 120 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] reservation_clean_interval = 86400 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] reservation_expire = 86400 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] reserved_image_namespaces = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] reserved_percentage = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] rpc_response_timeout = 120 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] run_external_periodic_tasks = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] scst_target_driver = iscsi {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] scst_target_iqn_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_down_time = 720 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] shell_completion = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] snapshot_name_template = snapshot-%s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] snapshot_same_host = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] split_loggers = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] state_path = /opt/stack/data/cinder {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] storage_availability_zone = nova {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] storage_protocol = iSCSI {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] syslog_log_facility = LOG_USER {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] target_helper = lioadm {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] target_ip_address = 192.168.122.71 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] target_port = 3260 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] target_protocol = iscsi {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] target_secondary_ip_addresses = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] trace_flags = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] transport_url = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] until_refresh = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_chap_auth = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_default_quota_class = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_journal = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_json = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_multipath_for_image_xfer = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_stderr = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] use_syslog = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] verify_glance_signatures = enabled {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_api_class = cinder.volume.api.API {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_backend_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_clear = zero {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_clear_ionice = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_clear_size = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_copy_bps_limit = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_dd_blocksize = 1M {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_name_template = volume-%s {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_service_inithost_offload = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volume_usage_audit_period = month {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] zoning_mode = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_concurrency.disable_process_locking = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.auth_section = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.auth_type = password {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.auth_version = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.cache = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.include_service_catalog = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.insecure = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.interface = public {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_password = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:24 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcache_username = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.region_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.service_type = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.backend = dogpile.cache.null {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.backend_argument = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.backend_expiration_time = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.config_prefix = cache.oslo {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.debug_cache_backend = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.enable_retry_client = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.enable_socket_keepalive = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.expiration_time = 600 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.hashclient_retry_attempts = 2 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_dead_retry = 300 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_pool_maxsize = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_sasl_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.password = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack sudo[76078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.proxies = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.redis_db = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.redis_server = localhost:6379 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.retry_attempts = 2 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack sudo[76078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.retry_delay = 0.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.socket_keepalive_count = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.socket_keepalive_idle = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.socket_keepalive_interval = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.socket_timeout = 1.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.tls_allowed_ciphers = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.tls_cafile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.tls_certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.tls_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.tls_keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cache.username = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] coordination.backend_url = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.asyncio_connection = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.asyncio_slave_connection = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.backend = sqlalchemy {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.connection = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.connection_debug = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.connection_parameters = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.connection_recycle_time = 3600 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.connection_trace = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.db_inc_retry_interval = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.db_max_retries = 20 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.db_max_retry_interval = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.db_retry_interval = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.max_overflow = 50 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.max_pool_size = 5 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.max_retries = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.mysql_wsrep_sync_wait = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.pool_timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.retry_interval = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.slave_connection = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.sqlite_synchronous = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.synchronous_reader = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] database.use_db_reconnect = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.connection_string = messaging:// {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.es_doc_type = notification {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.es_scroll_size = 10000 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.es_scroll_time = 2m {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.filter_error_trace = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.hmac_keys = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.sentinel_service_name = mymaster {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.socket_timeout = 0.1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.trace_requests = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler.trace_sqlalchemy = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler_jaeger.process_tags = {} {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler_jaeger.service_name_prefix = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] profiler_otlp.service_name_prefix = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.enforce_new_defaults = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.enforce_scope = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.policy_default_rule = default {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.policy_file = policy.yaml {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.group = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.helper_command = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] privsep_osbrick.user = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.group = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.helper_command = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] cinder_sys_admin.user = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.auth_section = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.auth_type = password {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.cafile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.collect_timing = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.insecure = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.send_service_user_token = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.split_loggers = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] service_user.timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.auth_section = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.auth_type = password {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.collect_timing = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.insecure = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.region_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.split_loggers = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] glance.timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.backend_availability_zone = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.chap_password = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.chap_username = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.disk_geometry = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.driver_client_cert = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.driver_client_cert_key = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.driver_data_namespace = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.driver_use_ssl = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.extra_capabilities = {} {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.filter_function = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.goodness_function = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.iscsi_target_flags = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.iscsi_write_cache = on {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.iser_helper = tgtadm {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.iser_port = 3260 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.lvm_share_target = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.lvm_type = auto {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.num_shell_tries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.replication_device = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.report_discard_supported = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.reserved_percentage = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.target_helper = tgtadm {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.target_port = 3260 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.target_protocol = iscsi {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.trace_flags = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.unique_fqdn_network = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.use_chap_auth = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_backend_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_clear = zero {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_clear_ionice = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_clear_size = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_reports.file_event_handler = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_reports.log_dir = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.backend_host = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.chap_password = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.chap_username = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.disk_geometry = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.driver_client_cert = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.extra_capabilities = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.filter_function = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.goodness_function = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.iser_helper = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.iser_ip_address = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.iser_port = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.lvm_share_target = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.lvm_type = auto {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.num_shell_tries = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.replication_device = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.report_discard_supported = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.reserved_percentage = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.scst_target_driver = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.storage_protocol = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.target_helper = lioadm {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.target_ip_address = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.target_port = 3260 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.trace_flags = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.use_chap_auth = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_clear = zero {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_clear_size = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] lvmdriver-1.volumes_dir = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_notifications.driver = [] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_notifications.retry = -1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] key_manager.fixed_key = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.barbican_api_version = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.barbican_endpoint = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.barbican_endpoint_type = public {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.barbican_region_name = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.cafile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.collect_timing = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.insecure = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.number_of_retries = 60 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.retry_delay = 1 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.send_service_user_token = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.split_loggers = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.verify_ssl = True {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican.verify_ssl_path = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.auth_section = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.auth_type = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.cafile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.certfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.collect_timing = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.insecure = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.keyfile = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.split_loggers = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] barbican_service_user.timeout = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.approle_role_id = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.approle_secret_id = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.kv_mountpoint = secret {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.kv_path = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.kv_version = 2 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.namespace = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.root_token_id = **** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.ssl_ca_crt_file = None {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.timeout = 60.0 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.use_ssl = False {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:29:24 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] ******************************************************************************** {{(pid=75905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 19:29:25 devstack sudo[76078]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:25 devstack sudo[76083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:25 devstack sudo[76083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:25 devstack sudo[76083]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.669s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:29:25 devstack cinder-volume[76074]: INFO cinder.brick.local_dev.lvm [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:25 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:26 devstack sudo[76279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:29:26 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:26 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:26 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:26 devstack cinder-volume[76074]: DEBUG cinder.brick.local_dev.lvm [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76074) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 19:29:26 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:26 devstack sudo[76479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:26 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:28 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:28 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.763s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:28 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:28 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:28 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:28 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:28 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:29 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:29 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.744s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:29 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:29 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:29 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:29 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 19:29:29 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:29 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:30 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.801s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:30 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:30 devstack sudo[76861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:29:30 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:30 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:30 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.822s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:30 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:30 devstack sudo[76873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:29:30 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:31 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:31 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.831s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:31 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:31 devstack sudo[76877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:31 devstack sudo[76877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:32 devstack sudo[76877]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:32 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:32 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:32 devstack sudo[76888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:32 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:33 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:33 devstack sudo[76892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:33 devstack sudo[76892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:33 devstack sudo[76892]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:33 devstack cinder-volume[76074]: INFO cinder.volume.drivers.lvm [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:33 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:33 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:33 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:34 devstack cinder-volume[75905]: DEBUG dbcounter [-] [75905] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:29:34 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:34 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:34 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:29:34 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:34 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:29:34 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:35 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:35 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:35 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:35 devstack sudo[77165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:35 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:35 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:35 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:35 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:35 devstack sudo[77168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:35 devstack sudo[77168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:36 devstack sudo[77168]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:36 devstack sudo[77172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:36 devstack sudo[77172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:36 devstack sudo[77172]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:37 devstack cinder-volume[76074]: INFO cinder.volume.driver [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Driver hasn't implemented _init_vendor_properties() Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG cinder.volume.driver [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76074) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG oslo_db.sqlalchemy.engines [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76074) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writer thread running {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG cinder.db.api [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Building query based on filter {{(pid=76074) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG cinder.image.image_utils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76074) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 19:29:37 devstack cinder-volume[76074]: INFO cinder.keymgr.migration [None req-5f6e27bc-3033-4a9e-8c98-59eea5488b40 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:37 devstack sudo[77176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:29:37 devstack sudo[77176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:37 devstack sudo[77176]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:37 devstack sudo[77180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:37 devstack sudo[77180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:38 devstack sudo[77180]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:38 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:38 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:38 devstack sudo[77186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:38 devstack sudo[77186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:39 devstack sudo[77186]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:39 devstack sudo[77189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:39 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:39 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:39 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:29:39 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Driver initialization completed successfully. Jul 10 19:29:39 devstack cinder-volume[76074]: INFO cinder.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Initiating service 2 cleanup Jul 10 19:29:39 devstack cinder-volume[76074]: INFO cinder.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Service 2 cleanup completed. Jul 10 19:29:39 devstack cinder-volume[76074]: DEBUG cinder.service [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Creating RPC server for service cinder-volume {{(pid=76074) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 19:29:39 devstack cinder-volume[76074]: DEBUG cinder.service [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76074) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 19:29:40 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 19:29:40 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:29:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:40 devstack sudo[77193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:29:40 devstack sudo[77193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:40 devstack sudo[77193]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:40 devstack sudo[77197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:40 devstack sudo[77197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:41 devstack sudo[77197]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:41 devstack sudo[77200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:29:41 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:42 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:29:42 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:29:42 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:29:42 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Jul 10 19:29:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:29:42 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-efca1347-a1e1-4916-b04c-85a7ff17480b None None] Driver post RPC initialization completed successfully. Jul 10 19:29:52 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:29:52 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:29:58 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:29:58 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:29:58 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread info: [<_MainThread(MainThread, started 139803392331904)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:30:58 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:30:58 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:30:58 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:30:58 devstack sudo[79541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:30:58 devstack sudo[79541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:30:59 devstack sudo[79541]: pam_unix(sudo:session): session closed for user root Jul 10 19:30:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:30:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:30:59 devstack sudo[79544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:30:59 devstack sudo[79544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:30:59 devstack sudo[79544]: pam_unix(sudo:session): session closed for user root Jul 10 19:30:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:30:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:31:00 devstack sudo[79575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:31:00 devstack sudo[79575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:31:00 devstack sudo[79575]: pam_unix(sudo:session): session closed for user root Jul 10 19:31:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:31:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:31:00 devstack sudo[79578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:31:00 devstack sudo[79578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:31:01 devstack sudo[79578]: pam_unix(sudo:session): session closed for user root Jul 10 19:31:01 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:31:01 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:31:01 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:31:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:31:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread info: [<_MainThread(MainThread, started 139803392331904)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:31:52 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:31:58 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:31:58 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:31:58 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:31:58 devstack sudo[82552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:31:58 devstack sudo[82552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:31:59 devstack sudo[82552]: pam_unix(sudo:session): session closed for user root Jul 10 19:31:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:31:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:31:59 devstack sudo[82558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:31:59 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:31:59 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root Jul 10 19:31:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:31:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:32:00 devstack sudo[82567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:32:00 devstack sudo[82567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:32:00 devstack sudo[82567]: pam_unix(sudo:session): session closed for user root Jul 10 19:32:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:32:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:32:00 devstack sudo[82571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:32:00 devstack sudo[82571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:32:01 devstack sudo[82571]: pam_unix(sudo:session): session closed for user root Jul 10 19:32:01 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:32:01 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:32:01 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:32:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:32:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread info: [<_MainThread(MainThread, started 139803392331904)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:32:58 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:32:58 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:32:58 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:32:58 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:32:58 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:32:59 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Jul 10 19:32:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:32:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:32:59 devstack sudo[84773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:32:59 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:32:59 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root Jul 10 19:32:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:32:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:32:59 devstack sudo[84796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:32:59 devstack sudo[84796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:33:00 devstack sudo[84796]: pam_unix(sudo:session): session closed for user root Jul 10 19:33:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:33:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:33:00 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:33:00 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:33:01 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Jul 10 19:33:01 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:33:01 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:33:01 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:33:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:33:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread info: [<_MainThread(MainThread, started 139803392331904)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:33:52 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:33:58 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:33:58 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 19:33:58 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:33:58 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 19:33:58 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:33:59 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Jul 10 19:33:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:33:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:33:59 devstack sudo[85885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:33:59 devstack sudo[85885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:33:59 devstack sudo[85885]: pam_unix(sudo:session): session closed for user root Jul 10 19:33:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:33:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:00 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 19:34:00 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:00 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:00 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:00 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 19:34:00 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:01 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:01 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:01 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:34:01 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:34:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:34:01 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-d4889a69-1b7a-40ab-925b-4e43c2505b07 None None] thread info: [<_MainThread(MainThread, started 139803392331904)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:34:04 devstack cinder-volume[75905]: INFO oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Caught SIGTERM, stopping children Jul 10 19:34:04 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Acquiring lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:34:04 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Acquired lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:34:04 devstack cinder-volume[75905]: DEBUG oslo_concurrency.lockutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Releasing lock "singleton_lock" {{(pid=75905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:34:04 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Stop services. {{(pid=75905) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 19:34:04 devstack cinder-volume[75905]: DEBUG oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Killing children. {{(pid=75905) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 19:34:04 devstack cinder-volume[75905]: INFO oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Waiting on 1 children to exit Jul 10 19:34:04 devstack cinder-volume[76074]: DEBUG oslo_concurrency.lockutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Acquiring lock "singleton_lock" {{(pid=76074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:34:04 devstack cinder-volume[76074]: DEBUG oslo_concurrency.lockutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Acquired lock "singleton_lock" {{(pid=76074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:34:04 devstack cinder-volume[76074]: DEBUG oslo_concurrency.lockutils [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Releasing lock "singleton_lock" {{(pid=76074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:34:04 devstack cinder-volume[76074]: WARNING amqp [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 19:34:04 devstack cinder-volume[76074]: WARNING amqp [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 19:34:05 devstack cinder-volume[75905]: INFO oslo_service.backend._eventlet.service [None req-d03bd256-99bb-43f2-a96e-6b256078fa6d None None] Child 76074 exited with status 0 Jul 10 19:34:05 devstack cinder-volume[86175]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 19:34:05 devstack cinder-volume[86175]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 19:34:05 devstack cinder-volume[86175]: we strongly recommend against using it for new projects. Jul 10 19:34:05 devstack cinder-volume[86175]: If you are already using Eventlet, we recommend migrating to a different Jul 10 19:34:05 devstack cinder-volume[86175]: framework. For more detail see Jul 10 19:34:05 devstack cinder-volume[86175]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 19:34:05 devstack cinder-volume[86175]: import eventlet # noqa Jul 10 19:34:07 devstack cinder-volume[86175]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:34:07 devstack cinder-volume[86175]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:34:07 devstack cinder-volume[86175]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:34:08 devstack cinder-volume[86175]: INFO dbcounter [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Registered counter for database cinder Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_db.sqlalchemy.engines [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG dbcounter [-] [86175] Writer thread running {{(pid=86175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 19:34:08 devstack cinder-volume[86175]: INFO cinder.rpc [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 19:34:08 devstack cinder-volume[86175]: INFO cinder.rpc [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_db.sqlalchemy.engines [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:08 devstack cinder-volume[86175]: INFO cinder.volume.manager [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Determined volume DB was empty at startup. Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG cinder.volume.manager [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86175) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 19:34:08 devstack cinder-volume[86175]: INFO cinder.volume.manager [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 19:34:08 devstack cinder-volume[86175]: WARNING stevedore.named [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 19:34:08 devstack cinder-volume[86175]: WARNING castellan.key_manager [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:34:08 devstack cinder-volume[86175]: WARNING cinder.keymgr.conf_key_mgr [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:34:08 devstack cinder-volume[86175]: INFO cinder.volume.manager [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_db.sqlalchemy.engines [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:08 devstack cinder-volume[86175]: INFO oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Starting 1 workers Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Started child 86391 {{(pid=86175) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 19:34:08 devstack cinder-volume[86391]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Full set of CONF: {{(pid=86175) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] ******************************************************************************** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Configuration options gathered from: {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] ================================================================================ {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] allow_availability_zone_fallback = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] allow_compression_on_image_upload = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] allowed_direct_url_schemes = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] api_rate_limit = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] auth_strategy = keystone {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_availability_zone = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_host = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_stats_polling_interval = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backup_api_class = cinder.backup.api.API {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backup_name_template = backup-%s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backup_use_same_host = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backup_use_temp_snapshot = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] chap_password = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] chap_username = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_internal_tenant_project_id = 9c403ce7fdde414eaadf8f6e3b4a3610 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_internal_tenant_user_id = aa7e38cefbc948f8a31e1ae23d04463f {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cluster = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] compression_format = gzip {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] compute_api_class = cinder.compute.nova.API {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] config_dir = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] config_source = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] control_exchange = openstack {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] debug = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] default_availability_zone = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] default_group_type = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] default_volume_type = QuobyteHD {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] disk_geometry = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] driver_client_cert = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] driver_client_cert_key = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] driver_data_namespace = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] driver_ssl_cert_path = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] driver_ssl_cert_verify = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] driver_use_ssl = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] enable_new_services = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] enable_unsupported_driver = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] enabled_backends = ['QuobyteHD'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:08 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] enforce_multipath_for_image_xfer = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] filter_function = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_api_insecure = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_api_ssl_compression = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_ca_certificates_file = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_catalog_info = image:glance:publicURL {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_num_retries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance_request_timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] goodness_function = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] graceful_shutdown_timeout = 5 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] group_api_class = cinder.group.api.API {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] host = devstack {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_compress_on_upload = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_conversion_address_space_limit = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_conversion_cpu_limit = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_conversion_disable = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_upload_use_cinder_backend = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_upload_use_internal_tenant = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_volume_cache_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_volume_cache_max_count = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] image_volume_cache_max_size_gb = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] init_host_max_objects_retrieval = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] instance_format = [instance: %(uuid)s] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] iscsi_target_flags = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] iscsi_write_cache = on {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] iser_helper = tgtadm {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] iser_ip_address = 192.168.122.71 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] iser_port = 3260 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_color = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_config_append = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_dir = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_file = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_options = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_rotate_interval = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_rotate_interval_type = days {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] log_rotation_type = none {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.remotefs [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86391) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] max_age = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] max_logfile_count = 30 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] max_logfile_size_mb = 200 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] max_over_subscription_ratio = 20.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] message_reap_interval = 86400 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] message_ttl = 2592000 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] migration_create_volume_timeout_secs = 300 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] monkey_patch = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] monkey_patch_modules = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] my_ip = 192.168.122.71 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] no_snapshot_gb_quota = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] num_iser_scan_tries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] num_shell_tries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] num_volume_device_scan_tries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] nvmeof_conn_info_version = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] nvmet_ns_id = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] nvmet_port_id = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_max_limit = 1000 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_volume_ext_list = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_volume_listen_port = 8776 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_volume_use_ssl = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] osapi_volume_workers = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] per_volume_size_limit = -1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] periodic_fuzzy_delay = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] periodic_interval = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] public_endpoint = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] publish_errors = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_backup_gigabytes = 1000 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_backups = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_gigabytes = 1000 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_groups = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_snapshots = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] quota_volumes = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] rate_limit_burst = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] rate_limit_except_level = CRITICAL {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] rate_limit_interval = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] reinit_driver_count = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] replication_device = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] report_discard_supported = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] report_interval = 120 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] reservation_clean_interval = 86400 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] reservation_expire = 86400 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] reserved_image_namespaces = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] reserved_percentage = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] rpc_response_timeout = 120 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] run_external_periodic_tasks = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] scst_target_driver = iscsi {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] scst_target_iqn_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_down_time = 720 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] shell_completion = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] snapshot_name_template = snapshot-%s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] split_loggers = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] state_path = /opt/stack/data/cinder {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] storage_availability_zone = nova {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] storage_protocol = iSCSI {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] syslog_log_facility = LOG_USER {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] target_helper = lioadm {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] target_ip_address = 192.168.122.71 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] target_port = 3260 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] target_protocol = iscsi {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] target_secondary_ip_addresses = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] trace_flags = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] transport_url = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] until_refresh = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_chap_auth = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_default_quota_class = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_journal = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_json = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_multipath_for_image_xfer = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_stderr = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] use_syslog = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] verify_glance_signatures = enabled {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_api_class = cinder.volume.api.API {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_backend_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_clear = zero {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_clear_ionice = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_clear_size = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_copy_bps_limit = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_dd_blocksize = 1M {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_name_template = volume-%s {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_service_inithost_offload = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volume_usage_audit_period = month {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] zoning_mode = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_concurrency.disable_process_locking = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.auth_section = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.auth_type = password {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.auth_version = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.cache = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.include_service_catalog = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.insecure = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.interface = public {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_password = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcache_username = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.region_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.service_type = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.backend = dogpile.cache.null {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.backend_argument = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.backend_expiration_time = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.config_prefix = cache.oslo {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.debug_cache_backend = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.enable_retry_client = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.enable_socket_keepalive = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.expiration_time = 600 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.hashclient_retry_attempts = 2 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_dead_retry = 300 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_pool_maxsize = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_sasl_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.password = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.proxies = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.redis_db = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.redis_server = localhost:6379 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.retry_attempts = 2 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.retry_delay = 0.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.socket_keepalive_count = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.socket_keepalive_idle = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.socket_keepalive_interval = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.socket_timeout = 1.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.tls_allowed_ciphers = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.tls_cafile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.tls_certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.tls_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.tls_keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cache.username = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] coordination.backend_url = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.asyncio_connection = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.asyncio_slave_connection = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.backend = sqlalchemy {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.connection = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.connection_debug = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.connection_parameters = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.connection_recycle_time = 3600 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.connection_trace = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.db_inc_retry_interval = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.db_max_retries = 20 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.db_max_retry_interval = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.db_retry_interval = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.max_overflow = 50 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.max_pool_size = 5 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.max_retries = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.mysql_wsrep_sync_wait = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.pool_timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.retry_interval = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.slave_connection = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.sqlite_synchronous = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.synchronous_reader = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] database.use_db_reconnect = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.connection_string = messaging:// {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.es_doc_type = notification {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.es_scroll_size = 10000 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.es_scroll_time = 2m {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.filter_error_trace = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.hmac_keys = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.sentinel_service_name = mymaster {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.socket_timeout = 0.1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.trace_requests = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler.trace_sqlalchemy = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler_jaeger.process_tags = {} {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler_jaeger.service_name_prefix = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] profiler_otlp.service_name_prefix = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.enforce_new_defaults = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.enforce_scope = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.policy_default_rule = default {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.policy_file = policy.yaml {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.group = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.helper_command = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] privsep_osbrick.user = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.group = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.helper_command = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] cinder_sys_admin.user = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.auth_section = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.auth_type = password {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.cafile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.collect_timing = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.insecure = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.send_service_user_token = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.split_loggers = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] service_user.timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.auth_section = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.auth_type = password {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.collect_timing = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.insecure = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.region_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.split_loggers = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] glance.timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.backend_availability_zone = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.chap_password = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.chap_username = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.disk_geometry = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.driver_client_cert = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.driver_client_cert_key = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.driver_data_namespace = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.driver_use_ssl = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.extra_capabilities = {} {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.filter_function = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.goodness_function = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.iscsi_target_flags = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.iscsi_write_cache = on {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.iser_helper = tgtadm {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.iser_port = 3260 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_host = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_login = admin {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_mount_options = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_password = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_private_key = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_share_path = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.num_shell_tries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.quobyte_volume_url = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.replication_device = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.report_discard_supported = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.reserved_percentage = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.target_helper = tgtadm {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.target_port = 3260 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.target_protocol = iscsi {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.trace_flags = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.unique_fqdn_network = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.use_chap_auth = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_backend_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_clear = zero {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_clear_ionice = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_clear_size = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86391) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 19:34:09 devstack cinder-volume[86391]: WARNING cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_reports.file_event_handler = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_reports.log_dir = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.backend_availability_zone = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.backend_host = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86391]: WARNING cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.chap_password = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.chap_username = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.chiscsi_conf = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.disk_geometry = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Running cmd (subprocess): mount.quobyte {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.driver_client_cert = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.driver_data_namespace = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.driver_use_ssl = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.extra_capabilities = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.filter_function = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.goodness_function = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.iser_helper = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.iser_ip_address = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.iser_port = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.iser_target_prefix = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_host = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_login = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_mount_options = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_password = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_private_key = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_share_path = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_ssh_port = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.num_shell_tries = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.nvmet_port_id = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.replication_device = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.report_discard_supported = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.reserved_percentage = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.scst_target_driver = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.storage_protocol = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.target_helper = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.target_ip_address = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.target_port = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.target_prefix = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.target_protocol = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.trace_flags = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.use_chap_auth = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_clear = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_clear_size = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] QuobyteHD.volumes_dir = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_notifications.driver = [] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_notifications.retry = -1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] key_manager.fixed_key = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.barbican_api_version = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.barbican_endpoint = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.barbican_endpoint_type = public {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.barbican_region_name = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.cafile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.collect_timing = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.insecure = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.number_of_retries = 60 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.retry_delay = 1 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.send_service_user_token = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.split_loggers = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.verify_ssl = True {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican.verify_ssl_path = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.auth_section = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.auth_type = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.cafile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.certfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.collect_timing = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.insecure = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.keyfile = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.split_loggers = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] barbican_service_user.timeout = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.approle_role_id = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.approle_secret_id = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.kv_mountpoint = secret {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.kv_path = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.kv_version = 2 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.namespace = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.root_token_id = **** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.ssl_ca_crt_file = None {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.timeout = 60.0 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.use_ssl = False {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:09 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] ******************************************************************************** {{(pid=86175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 19:34:09 devstack quobyte-client[86396]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 19:34:09 devstack quobyte-client[86396]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=86391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:09 devstack cinder-volume[86391]: INFO cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 ... Jul 10 19:34:09 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a -c /etc/quobyte/client-cinder.cfg {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:09 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a -c /etc/quobyte/client-cinder.cfg Jul 10 19:34:09 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:10 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.763s {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:10 devstack cinder-volume[86391]: INFO cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 succeeded Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=86391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.774s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:10 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:10 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:10 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.742s {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:10 devstack cinder-volume[86391]: INFO cinder.volume.driver [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG cinder.volume.driver [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7481727600098, 'free_capacity_gb': 1775.7481727600098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86391) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG oslo_db.sqlalchemy.engines [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:10 devstack cinder-volume[86391]: DEBUG dbcounter [-] [86391] Writer thread running {{(pid=86391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.db.api [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Building query based on filter {{(pid=86391) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.image.image_utils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86391) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 19:34:11 devstack cinder-volume[86391]: INFO cinder.keymgr.migration [None req-0a5c4d95-2e88-49d1-a76d-93e29130a80a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=86391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=86391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:11 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:11 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:11 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.789s {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Notifying Schedulers of capabilities ... {{(pid=86391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:34:11 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Driver initialization completed successfully. Jul 10 19:34:11 devstack cinder-volume[86391]: INFO cinder.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Initiating service 3 cleanup Jul 10 19:34:11 devstack cinder-volume[86391]: INFO cinder.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Service 3 cleanup completed. Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.service [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Creating RPC server for service cinder-volume {{(pid=86391) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 19:34:11 devstack cinder-volume[86391]: DEBUG cinder.service [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86391) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 19:34:12 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=86391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=86391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:12 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:12 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:12 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:12 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.686s {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:12 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-a2013bcc-09bf-420b-a357-9d7740483554 None None] Driver post RPC initialization completed successfully. Jul 10 19:34:14 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:14 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:14 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=86391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:14 devstack cinder-volume[86391]: DEBUG cinder.volume.drivers.quobyte [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=86391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:14 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:14 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:14 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:14 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:15 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:15 devstack cinder-volume[86391]: DEBUG oslo_concurrency.processutils [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.608s {{(pid=86391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:15 devstack cinder-volume[86391]: DEBUG cinder.manager [None req-819f86ec-bc83-4acc-9c65-e2717ff140ee None None] Notifying Schedulers of capabilities ... {{(pid=86391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:34:18 devstack cinder-volume[86175]: INFO oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Caught SIGTERM, stopping children Jul 10 19:34:18 devstack cinder-volume[86175]: DEBUG oslo_concurrency.lockutils [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Acquiring lock "singleton_lock" {{(pid=86175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:34:18 devstack cinder-volume[86175]: DEBUG oslo_concurrency.lockutils [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Acquired lock "singleton_lock" {{(pid=86175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:34:18 devstack cinder-volume[86175]: DEBUG oslo_concurrency.lockutils [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Releasing lock "singleton_lock" {{(pid=86175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:34:18 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Stop services. {{(pid=86175) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 19:34:18 devstack cinder-volume[86175]: DEBUG oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Killing children. {{(pid=86175) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 19:34:18 devstack cinder-volume[86175]: INFO oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Waiting on 1 children to exit Jul 10 19:34:20 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Acquiring lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:34:20 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Acquired lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:34:20 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Releasing lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:34:20 devstack cinder-volume[86391]: WARNING amqp [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 19:34:20 devstack cinder-volume[86391]: WARNING amqp [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 19:34:20 devstack cinder-volume[86175]: INFO oslo_service.backend._eventlet.service [None req-667b922d-641b-4ca4-bd57-4bc30a06d979 None None] Child 86391 exited with status 0 Jul 10 19:34:21 devstack cinder-volume[86844]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 19:34:21 devstack cinder-volume[86844]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 19:34:21 devstack cinder-volume[86844]: we strongly recommend against using it for new projects. Jul 10 19:34:21 devstack cinder-volume[86844]: If you are already using Eventlet, we recommend migrating to a different Jul 10 19:34:21 devstack cinder-volume[86844]: framework. For more detail see Jul 10 19:34:21 devstack cinder-volume[86844]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 19:34:21 devstack cinder-volume[86844]: import eventlet # noqa Jul 10 19:34:23 devstack cinder-volume[86844]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86844) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 19:34:23 devstack cinder-volume[86844]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86844) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 19:34:23 devstack cinder-volume[86844]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86844) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 19:34:24 devstack cinder-volume[86844]: INFO dbcounter [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Registered counter for database cinder Jul 10 19:34:24 devstack cinder-volume[86844]: DEBUG oslo_db.sqlalchemy.engines [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86844) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG dbcounter [-] [86844] Writer thread running {{(pid=86844) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 19:34:25 devstack cinder-volume[86844]: INFO cinder.rpc [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 19:34:25 devstack cinder-volume[86844]: INFO cinder.rpc [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_db.sqlalchemy.engines [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86844) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:25 devstack cinder-volume[86844]: INFO cinder.volume.manager [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Determined volume DB was empty at startup. Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG cinder.volume.manager [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86844) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 19:34:25 devstack cinder-volume[86844]: WARNING stevedore.named [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 19:34:25 devstack cinder-volume[86844]: WARNING castellan.key_manager [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:34:25 devstack cinder-volume[86844]: WARNING cinder.keymgr.conf_key_mgr [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 19:34:25 devstack cinder-volume[86844]: INFO cinder.volume.manager [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_db.sqlalchemy.engines [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86844) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:25 devstack cinder-volume[86844]: INFO oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Starting 1 workers Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Started child 87164 {{(pid=86844) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Full set of CONF: {{(pid=86844) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] ******************************************************************************** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] Configuration options gathered from: {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] ================================================================================ {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] allow_availability_zone_fallback = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] allow_compression_on_image_upload = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[87164]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] allowed_direct_url_schemes = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] api_rate_limit = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] auth_strategy = keystone {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_availability_zone = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_host = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_stats_polling_interval = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backup_api_class = cinder.backup.api.API {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backup_name_template = backup-%s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backup_use_same_host = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backup_use_temp_snapshot = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] chap_password = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] chap_username = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_internal_tenant_project_id = 9c403ce7fdde414eaadf8f6e3b4a3610 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_internal_tenant_user_id = aa7e38cefbc948f8a31e1ae23d04463f {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cluster = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] compression_format = gzip {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] compute_api_class = cinder.compute.nova.API {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] config_dir = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] config_source = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] control_exchange = openstack {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] debug = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] default_availability_zone = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] default_group_type = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] default_volume_type = QuobyteHD {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] disk_geometry = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] driver_client_cert = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] driver_client_cert_key = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] driver_data_namespace = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] driver_ssl_cert_path = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] driver_ssl_cert_verify = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] driver_use_ssl = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] enable_new_services = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] enable_unsupported_driver = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] enabled_backends = ['QuobyteHD'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] enforce_multipath_for_image_xfer = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] filter_function = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_api_insecure = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_api_ssl_compression = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_ca_certificates_file = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_catalog_info = image:glance:publicURL {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_num_retries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance_request_timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] goodness_function = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] graceful_shutdown_timeout = 5 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] group_api_class = cinder.group.api.API {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] host = devstack {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_compress_on_upload = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_conversion_address_space_limit = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_conversion_cpu_limit = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_conversion_disable = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_upload_use_cinder_backend = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_upload_use_internal_tenant = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_volume_cache_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_volume_cache_max_count = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] image_volume_cache_max_size_gb = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] init_host_max_objects_retrieval = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] instance_format = [instance: %(uuid)s] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] iscsi_target_flags = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] iscsi_write_cache = on {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] iser_helper = tgtadm {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] iser_ip_address = 192.168.122.71 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] iser_port = 3260 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_color = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_config_append = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_dir = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_file = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_options = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_rotate_interval = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_rotate_interval_type = days {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] log_rotation_type = none {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] max_age = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] max_logfile_count = 30 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] max_logfile_size_mb = 200 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] max_over_subscription_ratio = 20.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] message_reap_interval = 86400 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] message_ttl = 2592000 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] migration_create_volume_timeout_secs = 300 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] monkey_patch = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] monkey_patch_modules = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] my_ip = 192.168.122.71 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] no_snapshot_gb_quota = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] num_iser_scan_tries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] num_shell_tries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:25 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] num_volume_device_scan_tries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] nvmeof_conn_info_version = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] nvmet_ns_id = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] nvmet_port_id = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_max_limit = 1000 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_volume_ext_list = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_volume_listen_port = 8776 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_volume_use_ssl = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] osapi_volume_workers = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] per_volume_size_limit = -1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] periodic_fuzzy_delay = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] periodic_interval = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] public_endpoint = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] publish_errors = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_backup_gigabytes = 1000 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_backups = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_gigabytes = 1000 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_groups = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_snapshots = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] quota_volumes = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] rate_limit_burst = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] rate_limit_except_level = CRITICAL {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] rate_limit_interval = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] reinit_driver_count = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] replication_device = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] report_discard_supported = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] report_interval = 120 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] reservation_clean_interval = 86400 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] reservation_expire = 86400 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] reserved_image_namespaces = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] reserved_percentage = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] rpc_response_timeout = 120 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] run_external_periodic_tasks = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87164) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] scst_target_driver = iscsi {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] scst_target_iqn_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_down_time = 720 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] shell_completion = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] snapshot_name_template = snapshot-%s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] split_loggers = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] state_path = /opt/stack/data/cinder {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] storage_availability_zone = nova {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] storage_protocol = iSCSI {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] syslog_log_facility = LOG_USER {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] target_helper = lioadm {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] target_ip_address = 192.168.122.71 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] target_port = 3260 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] target_protocol = iscsi {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] target_secondary_ip_addresses = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] trace_flags = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] transport_url = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] until_refresh = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_chap_auth = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_default_quota_class = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_journal = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_json = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_multipath_for_image_xfer = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_stderr = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] use_syslog = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] verify_glance_signatures = enabled {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_api_class = cinder.volume.api.API {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_backend_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_clear = zero {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_clear_ionice = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_clear_size = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_copy_bps_limit = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_dd_blocksize = 1M {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_name_template = volume-%s {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_service_inithost_offload = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volume_usage_audit_period = month {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] zoning_mode = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_concurrency.disable_process_locking = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.auth_section = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.auth_type = password {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.auth_version = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.cache = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.include_service_catalog = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.insecure = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.interface = public {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_password = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcache_username = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.region_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.service_type = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.backend = dogpile.cache.null {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.backend_argument = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.backend_expiration_time = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.config_prefix = cache.oslo {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.debug_cache_backend = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.enable_retry_client = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.enable_socket_keepalive = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.expiration_time = 600 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.hashclient_retry_attempts = 2 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_dead_retry = 300 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_pool_maxsize = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_sasl_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.password = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.proxies = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.redis_db = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.redis_server = localhost:6379 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.retry_attempts = 2 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.retry_delay = 0.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.socket_keepalive_count = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.socket_keepalive_idle = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.socket_keepalive_interval = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.socket_timeout = 1.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.tls_allowed_ciphers = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.tls_cafile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.tls_certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.tls_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.tls_keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cache.username = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] coordination.backend_url = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.asyncio_connection = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.asyncio_slave_connection = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.backend = sqlalchemy {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.connection = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.connection_debug = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.connection_parameters = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.connection_recycle_time = 3600 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.connection_trace = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.db_inc_retry_interval = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.db_max_retries = 20 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.db_max_retry_interval = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.db_retry_interval = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.max_overflow = 50 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.max_pool_size = 5 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.max_retries = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.mysql_wsrep_sync_wait = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.pool_timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.retry_interval = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.slave_connection = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.sqlite_synchronous = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.synchronous_reader = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] database.use_db_reconnect = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.connection_string = messaging:// {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.es_doc_type = notification {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.es_scroll_size = 10000 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.es_scroll_time = 2m {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.filter_error_trace = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.hmac_keys = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.sentinel_service_name = mymaster {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.socket_timeout = 0.1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.trace_requests = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler.trace_sqlalchemy = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler_jaeger.process_tags = {} {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler_jaeger.service_name_prefix = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] profiler_otlp.service_name_prefix = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.enforce_new_defaults = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.enforce_scope = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.policy_default_rule = default {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.policy_file = policy.yaml {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.group = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.helper_command = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] privsep_osbrick.user = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87164) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 19:34:26 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 19:34:26 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.group = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.helper_command = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] cinder_sys_admin.user = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.auth_section = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.auth_type = password {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.cafile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.collect_timing = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.insecure = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.send_service_user_token = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.split_loggers = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] service_user.timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.auth_section = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.auth_type = password {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.collect_timing = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.insecure = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.region_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.split_loggers = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] glance.timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.backend_availability_zone = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.chap_password = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.chap_username = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.disk_geometry = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.driver_client_cert = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.driver_client_cert_key = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.driver_data_namespace = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.driver_use_ssl = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.extra_capabilities = {} {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.filter_function = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.goodness_function = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.iscsi_target_flags = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.iscsi_write_cache = on {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.iser_helper = tgtadm {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.iser_port = 3260 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_host = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_login = admin {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_mount_options = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_password = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_private_key = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_share_path = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.num_shell_tries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.quobyte_volume_url = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.replication_device = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.report_discard_supported = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.reserved_percentage = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.target_helper = tgtadm {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.target_port = 3260 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.target_protocol = iscsi {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.trace_flags = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.unique_fqdn_network = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.use_chap_auth = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_backend_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_clear = zero {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_clear_ionice = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_clear_size = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_reports.file_event_handler = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_reports.log_dir = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.backend_availability_zone = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.backend_host = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.chap_password = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.chap_username = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.chiscsi_conf = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.disk_geometry = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.driver_client_cert = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.driver_data_namespace = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.driver_use_ssl = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.extra_capabilities = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.filter_function = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.goodness_function = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.iser_helper = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.iser_ip_address = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.iser_port = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.iser_target_prefix = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_host = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_login = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_mount_options = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_password = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_private_key = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_share_path = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_ssh_port = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.num_shell_tries = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.nvmet_port_id = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.replication_device = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.report_discard_supported = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.reserved_percentage = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.scst_target_driver = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.storage_protocol = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.target_helper = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.target_ip_address = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.target_port = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.target_prefix = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.target_protocol = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.trace_flags = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.use_chap_auth = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_clear = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_clear_size = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] QuobyteHD.volumes_dir = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_notifications.driver = [] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_notifications.retry = -1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] key_manager.fixed_key = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.barbican_api_version = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.barbican_endpoint = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.barbican_endpoint_type = public {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.barbican_region_name = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.cafile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.collect_timing = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.insecure = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.number_of_retries = 60 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.retry_delay = 1 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.send_service_user_token = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.split_loggers = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.verify_ssl = True {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican.verify_ssl_path = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.auth_section = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.auth_type = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.cafile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.certfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.collect_timing = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.insecure = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.keyfile = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.split_loggers = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] barbican_service_user.timeout = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.approle_role_id = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.approle_secret_id = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.kv_mountpoint = secret {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.kv_path = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.kv_version = 2 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.namespace = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.root_token_id = **** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.ssl_ca_crt_file = None {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.timeout = 60.0 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.use_ssl = False {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 19:34:26 devstack cinder-volume[86844]: DEBUG oslo_service.backend._eventlet.service [None req-bc82e84c-0ed7-4de6-b4b0-f8b091ef6a01 None None] ******************************************************************************** {{(pid=86844) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 19:34:26 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:26 devstack cinder-volume[87164]: INFO cinder.volume.driver [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG cinder.volume.driver [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7570419311523, 'free_capacity_gb': 1775.7570419311523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87164) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 19:34:26 devstack cinder-volume[87164]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writer thread running {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.db.api [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Building query based on filter {{(pid=87164) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87164) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:27 devstack cinder-volume[87164]: INFO cinder.keymgr.migration [None req-23a9afec-e9e4-4a76-b8a0-70777c47ab77 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 19:34:27 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:27 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:27 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.634s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:34:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Driver initialization completed successfully. Jul 10 19:34:27 devstack cinder-volume[87164]: INFO cinder.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Initiating service 3 cleanup Jul 10 19:34:27 devstack cinder-volume[87164]: INFO cinder.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Service 3 cleanup completed. Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.service [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Creating RPC server for service cinder-volume {{(pid=87164) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.service [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87164) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 19:34:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:34:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:34:27 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:34:27 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:34:28 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Jul 10 19:34:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.649s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:34:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a0ebe749-4630-4190-810c-715f60a952d5 None None] Driver post RPC initialization completed successfully. Jul 10 19:34:35 devstack cinder-volume[86844]: DEBUG dbcounter [-] [86844] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86844) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:34:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:34:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 6 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:34:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:34:37 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=2 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:34:38 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:37 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:35:37 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:40 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 2.481s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:40 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:35:40 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:35:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 6 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:35:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Flow 'volume_create_manager' (d19d58e9-3c16-4f2f-ba9a-5793b22d8069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e52bab-3bd3-40ca-a49c-71fa5f1fd5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e52bab-3bd3-40ca-a49c-71fa5f1fd5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1038198961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d05bbc-011a-4188-a591-0b4e3597f8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b3f08f06fc4f709a998549c07327eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:35:42Z,use_quota=True,user_id='e83417d2a54b493783fa05d66ba2bed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fd6248-973d-4962-8c35-89e4f2695164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fd6248-973d-4962-8c35-89e4f2695164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8607d600-c6f9-46ac-8f0b-9b890e1998b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8607d600-c6f9-46ac-8f0b-9b890e1998b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d05bbc-011a-4188-a591-0b4e3597f8c3', 'volume_name': 'volume-81d05bbc-011a-4188-a591-0b4e3597f8c3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d93812-780f-4a6f-99e8-1b3966cf4421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d93812-780f-4a6f-99e8-1b3966cf4421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fa3082-673a-462f-ada8-86128fc29f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:42 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Volume 81d05bbc-011a-4188-a591-0b4e3597f8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d05bbc-011a-4188-a591-0b4e3597f8c3', 'volume_size': 1} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1038198961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d05bbc-011a-4188-a591-0b4e3597f8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b3f08f06fc4f709a998549c07327eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:35:42Z,use_quota=True,user_id='e83417d2a54b493783fa05d66ba2bed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Creating volume 81d05bbc-011a-4188-a591-0b4e3597f8c3 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:35:42 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:35:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:42 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 1073741824 Jul 10 19:35:42 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:45 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 1073741824" returned: 0 in 2.593s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:45 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 Jul 10 19:35:45 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:47 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3" returned: 0 in 1.623s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] <== create_volume: return (4409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.423s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fa3082-673a-462f-ada8-86128fc29f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d05bbc-011a-4188-a591-0b4e3597f8c3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ee5dd8-b4bf-4975-af09-c6db43990fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Volume volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 (81d05bbc-011a-4188-a591-0b4e3597f8c3): created successfully Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ee5dd8-b4bf-4975-af09-c6db43990fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Flow 'volume_create_manager' (d19d58e9-3c16-4f2f-ba9a-5793b22d8069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:35:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e21b288f-182c-4053-9f21-89719e1dfaaa tempest-DeleteServersTestJSON-1216867325 None] Created volume successfully. Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Flow 'volume_create_manager' (e6ed76e0-57f6-44d0-86a2-f84a767cc589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96977053-4b91-43ee-8538-36e43385b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96977053-4b91-43ee-8538-36e43385b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1225802159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332a95c-91d5-4beb-86f0-c70ea27eaee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747ec2de7c1e474fad2511380e00270f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:35:49Z,use_quota=True,user_id='7ebecef769374730b1e1bf1cf7ce58f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8395fd-7e71-4df7-8136-c2c7053239fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8395fd-7e71-4df7-8136-c2c7053239fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6420375-0c5e-44e9-8739-c9b6351d9828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6420375-0c5e-44e9-8739-c9b6351d9828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0332a95c-91d5-4beb-86f0-c70ea27eaee5', 'volume_name': 'volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad20367f-1e95-4b94-87c1-5eee06bfe5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad20367f-1e95-4b94-87c1-5eee06bfe5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1020f1-0558-48d9-a1a8-0dcc14475824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:48 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Volume 0332a95c-91d5-4beb-86f0-c70ea27eaee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5', 'volume_size': 1} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1225802159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332a95c-91d5-4beb-86f0-c70ea27eaee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747ec2de7c1e474fad2511380e00270f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:35:49Z,use_quota=True,user_id='7ebecef769374730b1e1bf1cf7ce58f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Creating volume 0332a95c-91d5-4beb-86f0-c70ea27eaee5 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:35:48 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:35:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:48 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 1073741824 Jul 10 19:35:48 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:50 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 1073741824" returned: 0 in 1.605s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:50 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 Jul 10 19:35:50 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:52 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5" returned: 0 in 1.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] <== create_volume: return (3378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.382s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1020f1-0558-48d9-a1a8-0dcc14475824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30f7c92-2a31-4fa4-84e4-73640c3120ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Volume volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 (0332a95c-91d5-4beb-86f0-c70ea27eaee5): created successfully Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30f7c92-2a31-4fa4-84e4-73640c3120ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Flow 'volume_create_manager' (e6ed76e0-57f6-44d0-86a2-f84a767cc589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:35:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-84bce4a2-db7f-45d8-9294-ff47676010c5 tempest-VolumesAdminNegativeTest-1569266405 None] Created volume successfully. Jul 10 19:35:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Acquiring lock "cinder-0332a95c-91d5-4beb-86f0-c70ea27eaee5-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:35:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "cinder-0332a95c-91d5-4beb-86f0-c70ea27eaee5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:35:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Acquiring lock "cinder-quobyte-0332a95c-91d5-4beb-86f0-c70ea27eaee5" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:35:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "cinder-quobyte-0332a95c-91d5-4beb-86f0-c70ea27eaee5" acquired by "delete_volume" :: waited 0.045s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:35:54 devstack cinder-volume[87164]: INFO oslo.privsep.daemon [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6dc9x4dx/privsep.sock'] Jul 10 19:35:54 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6dc9x4dx/privsep.sock Jul 10 19:35:54 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 19:35:55 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING py.warnings [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 10 19:35:56 devstack cinder-volume[87164]: .first() Jul 10 19:35:56 devstack cinder-volume[87164]: Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:56 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:56 devstack cinder-volume[87164]: INFO oslo.privsep.daemon [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Spawned new privsep daemon via rootwrap Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Accepted privsep connection to /tmp/tmp6dc9x4dx/privsep.sock {{(pid=87164) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 19:35:56 devstack cinder-volume[87164]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 19:35:56 devstack cinder-volume[87164]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 19:35:56 devstack cinder-volume[87164]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 19:35:56 devstack cinder-volume[87164]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88215 Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a712e-f48c-4a3f-8e5f-961cc95f8ac7]: (2,) {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:35:56 devstack cinder-volume[87164]: WARNING oslo_privsep.priv_context [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] privsep daemon already running Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[695492d6-ee8b-42d5-a944-2e81ecd9a9cc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a733091-3f07-431f-918f-f917cc37e8af]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:35:56 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 Jul 10 19:35:56 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Flow 'volume_create_manager' (242b6bda-d926-4aae-b7b0-057692cf401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5756e8c-2262-4435-aa9d-8061fe7f7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:56 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 Jul 10 19:35:56 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5756e8c-2262-4435-aa9d-8061fe7f7394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-107305479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc5e19d69aa469da6c88ac253af78c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:35:57Z,use_quota=True,user_id='b153ee4d326840668f4daaf64c472c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc10e3e3-f240-486d-afe5-abbac48ce133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc10e3e3-f240-486d-afe5-abbac48ce133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204f390f-f517-49a5-b1c7-2c4b079d2a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204f390f-f517-49a5-b1c7-2c4b079d2a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2', 'volume_name': 'volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df756d7-56a0-43d3-9bfa-3de63ed81cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df756d7-56a0-43d3-9bfa-3de63ed81cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857d9531-9513-41c1-a7c5-6bc8fe0ee296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:57 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Volume e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2', 'volume_size': 1} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:57 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-107305479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc5e19d69aa469da6c88ac253af78c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:35:57Z,use_quota=True,user_id='b153ee4d326840668f4daaf64c472c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Creating volume e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:35:57 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:57 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 1073741824 Jul 10 19:35:57 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:57 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-81d05bbc-011a-4188-a591-0b4e3597f8c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0923eeae-0e1a-40c5-8a2f-6a9b93d6e753', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5" returned: 0 in 0.899s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:57 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5 Jul 10 19:35:57 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-c48e0eb6-b951-4d60-9e44-52f0c5302294 req-2b4c27e2-04b2-4a8a-9cff-4babe1f5e18a tempest-DeleteServersTestJSON-1216867325 None] attachment_update completed successfully. Jul 10 19:35:58 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0332a95c-91d5-4beb-86f0-c70ea27eaee5" returned: 0 in 0.830s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "cinder-quobyte-0332a95c-91d5-4beb-86f0-c70ea27eaee5" released by "delete_volume" :: held 3.981s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:35:58 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 1073741824" returned: 0 in 0.986s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:58 devstack cinder-volume[87164]: WARNING cinder.quota [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:35:58 devstack cinder-volume[87164]: WARNING cinder.quota [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Created reservations ['d173d5c2-f73d-4611-95b9-e85c7c34f2ec', 'b2058b7f-b550-44b3-989f-dd527b5d2290', '6ab21cc9-6e7f-40ba-aa33-986d46ab3a8a', 'b4b5d5f1-44a7-47e1-855e-029f7d9f575c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:58 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 Jul 10 19:35:58 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:35:58 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:35:58 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:35:59 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" returned: 0 in 0.965s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857d9531-9513-41c1-a7c5-6bc8fe0ee296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde52679-04a0-4459-bb8f-8577630f3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:35:59 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Volume volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 (e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2): created successfully Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde52679-04a0-4459-bb8f-8577630f3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Flow 'volume_create_manager' (242b6bda-d926-4aae-b7b0-057692cf401f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:35:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-ddc138ec-f38b-475e-ac39-45b866ca9b53 req-076219db-e1fc-4cb0-aa3b-278cf8336e04 tempest-VolumesSnapshotsTestJSON-1125971236 None] Created volume successfully. Jul 10 19:35:59 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.968s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:35:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Deleted volume successfully. Jul 10 19:35:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d5531ae-5152-46bd-adf9-9ccd914b6454 tempest-VolumesAdminNegativeTest-1569266405 None] Lock "cinder-0332a95c-91d5-4beb-86f0-c70ea27eaee5-delete_volume" released by "delete_volume" :: held 5.436s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Creating offline snapshot fe4fabdc-4f59-4b51-9ed1-6f67878851d2 of volume e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:36:00 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e9600-e7a5-4485-9240-a9bf65806e97]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:00 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 Jul 10 19:36:00 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:01 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" returned: 0 in 1.154s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:01 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 1G Jul 10 19:36:01 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:02 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 1G" returned: 0 in 1.087s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:02 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 Jul 10 19:36:02 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:03 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2" returned: 0 in 0.940s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:03 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 is being set with open permissions: ugo+rw Jul 10 19:36:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:03 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 Jul 10 19:36:03 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:04 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2" returned: 0 in 0.701s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:04 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info Jul 10 19:36:04 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:05 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info" returned: 0 in 0.834s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:05 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info is being set with open permissions: ugo+rw Jul 10 19:36:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:05 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info Jul 10 19:36:05 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:06 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.info" returned: 0 in 0.762s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.576s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-835909f4-d14c-4ca2-a0e1-9871c58c50cb req-8d3c3e17-65de-4829-948f-b0f1b33c8380 tempest-VolumesSnapshotsTestJSON-1125971236 None] Create snapshot completed successfully Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "cinder-fe4fabdc-4f59-4b51-9ed1-6f67878851d2-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-fe4fabdc-4f59-4b51-9ed1-6f67878851d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "cinder-quobyte-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-quobyte-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "cinder-quobyte-fe4fabdc-4f59-4b51-9ed1-6f67878851d2" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-quobyte-fe4fabdc-4f59-4b51-9ed1-6f67878851d2" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Deleting offline snapshot fe4fabdc-4f59-4b51-9ed1-6f67878851d2 of volume e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] snapshot_file for this snap is: volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d417cf85-10ad-4bb5-a27a-b24a8b3308a2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Flow 'volume_create_manager' (4255e660-c578-4fec-8ffe-1d88fb21c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fd91e5-7dd1-4332-9449-f1ee11452e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fd91e5-7dd1-4332-9449-f1ee11452e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1352276041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ffed2f-2dbd-478b-930f-d66dec4d7cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe07091966714e41823ad17cf8ffe6a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:07Z,use_quota=True,user_id='c850df3366c248418a2ca1b593a159b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eaf633-db33-409b-856f-9729f4513ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eaf633-db33-409b-856f-9729f4513ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:06 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 Jul 10 19:36:06 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f6d900-ce4e-443b-bbc6-33e1838488dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f6d900-ce4e-443b-bbc6-33e1838488dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ffed2f-2dbd-478b-930f-d66dec4d7cc4', 'volume_name': 'volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc260a-6f4a-4fb2-b447-adbfbb2ad3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc260a-6f4a-4fb2-b447-adbfbb2ad3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0545e268-c9f4-4178-b8fb-1edafde32500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:06 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Volume 04ffed2f-2dbd-478b-930f-d66dec4d7cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4', 'volume_size': 1} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1352276041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ffed2f-2dbd-478b-930f-d66dec4d7cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe07091966714e41823ad17cf8ffe6a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:07Z,use_quota=True,user_id='c850df3366c248418a2ca1b593a159b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Creating volume 04ffed2f-2dbd-478b-930f-d66dec4d7cc4 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:06 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:06 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 1073741824 Jul 10 19:36:06 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:07 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-ab4c0d6e-0d77-4b97-83a1-8003ee684b42 req-4bb177b4-6ed2-482e-823d-4825ef7e2874 tempest-DeleteServersTestJSON-1216867325 None] Terminate volume connection completed successfully. Jul 10 19:36:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ab4c0d6e-0d77-4b97-83a1-8003ee684b42 req-4bb177b4-6ed2-482e-823d-4825ef7e2874 tempest-DeleteServersTestJSON-1216867325 None] Deleting attachment 0923eeae-0e1a-40c5-8a2f-6a9b93d6e753. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:36:07 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2" returned: 0 in 1.144s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:36:07 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d4f1ff-def1-49d9-9a0f-3f8cb107e75e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:07 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 1073741824" returned: 0 in 1.074s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:08 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 Jul 10 19:36:08 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:08 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 Jul 10 19:36:08 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:09 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" returned: 0 in 0.997s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0545e268-c9f4-4178-b8fb-1edafde32500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6148c21d-da2d-4632-acd6-04bbf6d5cca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:09 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Volume volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 (04ffed2f-2dbd-478b-930f-d66dec4d7cc4): created successfully Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6148c21d-da2d-4632-acd6-04bbf6d5cca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:09 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Flow 'volume_create_manager' (4255e660-c578-4fec-8ffe-1d88fb21c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" returned: 0 in 1.239s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9f333541-de66-4fb3-96ab-48b35abb76f4 tempest-ServerActionsTestOtherA-1691401630 None] Created volume successfully. Jul 10 19:36:09 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 Jul 10 19:36:09 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:10 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2" returned: 0 in 0.969s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:10 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2 Jul 10 19:36:10 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:10 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2.fe4fabdc-4f59-4b51-9ed1-6f67878851d2" returned: 0 in 0.788s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-quobyte-fe4fabdc-4f59-4b51-9ed1-6f67878851d2" released by "_delete_snapshot" :: held 4.340s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-quobyte-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" released by "delete_snapshot" :: held 4.382s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:11 devstack cinder-volume[87164]: WARNING cinder.quota [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:36:11 devstack cinder-volume[87164]: DEBUG cinder.quota [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Created reservations ['c9e2034b-8dfe-4a01-88cc-cbbf95fd2ec2', 'dbd41018-dd18-45d4-97fa-c2724d9f0be9', '5dbe9680-5ac0-41bf-86d5-8558959b7323', '4fc66c0e-899b-4332-b74a-fa030e87563c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:11 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Delete snapshot completed successfully. Jul 10 19:36:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-572e7bc7-6caf-4dee-aea1-a81a6411faf0 req-01039284-9647-4499-9c58-3984649d78f5 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-fe4fabdc-4f59-4b51-9ed1-6f67878851d2-delete_snapshot" released by "delete_snapshot" :: held 4.575s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Acquiring lock "cinder-81d05bbc-011a-4188-a591-0b4e3597f8c3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Lock "cinder-81d05bbc-011a-4188-a591-0b4e3597f8c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Acquiring lock "cinder-quobyte-81d05bbc-011a-4188-a591-0b4e3597f8c3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Lock "cinder-quobyte-81d05bbc-011a-4188-a591-0b4e3597f8c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d4c67-008f-403b-933b-59eda57bcfa8]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "cinder-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:12 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 Jul 10 19:36:12 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "cinder-quobyte-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-quobyte-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcce18-816c-4b8f-8d5a-374b33c088cd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:12 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 Jul 10 19:36:12 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:13 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3" returned: 0 in 0.890s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:13 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3 Jul 10 19:36:13 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:13 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" returned: 0 in 0.886s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:13 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2 Jul 10 19:36:13 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:13 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-81d05bbc-011a-4188-a591-0b4e3597f8c3" returned: 0 in 0.734s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Lock "cinder-quobyte-81d05bbc-011a-4188-a591-0b4e3597f8c3" released by "delete_volume" :: held 1.677s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Created reservations ['6613d757-ccf7-45b6-9a5f-dece36f43e2e', '75a5b04a-fb78-4136-853d-f3776884dc0f', '0e5d9c23-fe1c-450f-8564-4b6cda700b26', '50ef69bb-58d1-4641-bf22-1cba43d49911'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:14 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:14 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:14 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" returned: 0 in 0.820s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-quobyte-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2" released by "delete_volume" :: held 1.799s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG cinder.quota [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Created reservations ['c6296c48-fc2f-4066-b44e-8e4efc0a10ad', 'd0a56a8e-113a-4703-b1de-232acfd35fbe', '3b5ccf66-0b62-446a-8531-d080d91357f4', '2dba2cd4-f2a4-445d-b89b-9a7e107292c7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:14 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:14 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:14 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.813s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Deleted volume successfully. Jul 10 19:36:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-38a5301d-fd3d-4357-ad7e-dd4e4a8166db tempest-DeleteServersTestJSON-1216867325 None] Lock "cinder-81d05bbc-011a-4188-a591-0b4e3597f8c3-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:15 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.113s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:15 devstack cinder-volume[87164]: DEBUG cinder.manager [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Deleted volume successfully. Jul 10 19:36:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-ff910e53-9ae0-45d9-8aab-e88388dcd709 req-684a646c-09de-4368-ae9b-64cc552d5968 tempest-VolumesSnapshotsTestJSON-1125971236 None] Lock "cinder-e81f9d16-e6b7-4ff8-8925-6d7233fcb2c2-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Flow 'volume_create_manager' (1d39c400-2b65-47d0-b6c5-cc48be4c4b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f71ed9-54d6-4449-9526-3bbe61dcc8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f71ed9-54d6-4449-9526-3bbe61dcc8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-104065776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1428568d-c777-42bf-9656-487bf94d5502,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02b4be7714b4a62aa4fdda54506a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:21Z,use_quota=True,user_id='abc6af867b064661ac5764ce9a6a5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7bff15-58a6-4f7d-a11a-9fbd1a804ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7bff15-58a6-4f7d-a11a-9fbd1a804ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fee91f-8a22-46e6-99e8-f2d5a4156860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fee91f-8a22-46e6-99e8-f2d5a4156860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1428568d-c777-42bf-9656-487bf94d5502', 'volume_name': 'volume-1428568d-c777-42bf-9656-487bf94d5502', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbcda8e-9227-49de-929b-c8cea17bea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbcda8e-9227-49de-929b-c8cea17bea67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be18db3-ac56-46ff-9183-e2cf8f87035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Volume 1428568d-c777-42bf-9656-487bf94d5502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1428568d-c777-42bf-9656-487bf94d5502', 'volume_size': 1} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-104065776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1428568d-c777-42bf-9656-487bf94d5502,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02b4be7714b4a62aa4fdda54506a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:21Z,use_quota=True,user_id='abc6af867b064661ac5764ce9a6a5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Creating volume 1428568d-c777-42bf-9656-487bf94d5502 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:21 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:21 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 1073741824 Jul 10 19:36:21 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:22 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 1073741824" returned: 0 in 0.955s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:22 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 Jul 10 19:36:22 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:23 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502" returned: 0 in 0.854s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be18db3-ac56-46ff-9183-e2cf8f87035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1428568d-c777-42bf-9656-487bf94d5502', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995ebaee-8b34-4483-9ab4-7da4f0f8a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Volume volume-1428568d-c777-42bf-9656-487bf94d5502 (1428568d-c777-42bf-9656-487bf94d5502): created successfully Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995ebaee-8b34-4483-9ab4-7da4f0f8a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Flow 'volume_create_manager' (1d39c400-2b65-47d0-b6c5-cc48be4c4b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:23 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b35b2b8b-ef60-4443-aba9-8a1fa2515886 tempest-VolumesTestJSON-1978783444 None] Created volume successfully. Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Flow 'volume_create_manager' (2bf7a48a-30c9-4cd9-a19a-cf41e1bc6b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7315916-3570-4a75-b897-86e1d639e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7315916-3570-4a75-b897-86e1d639e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106538166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02bac9e-0d31-4994-8920-647d7d6094f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02b4be7714b4a62aa4fdda54506a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:25Z,use_quota=True,user_id='abc6af867b064661ac5764ce9a6a5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6db235-d0a9-48e2-8ebd-693b4903df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6db235-d0a9-48e2-8ebd-693b4903df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d101add1-9ce0-4fc9-840b-111099decdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d101add1-9ce0-4fc9-840b-111099decdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02bac9e-0d31-4994-8920-647d7d6094f1', 'volume_name': 'volume-b02bac9e-0d31-4994-8920-647d7d6094f1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c192b2d1-11d8-4d22-ae91-27e90e6c8cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c192b2d1-11d8-4d22-ae91-27e90e6c8cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab24e41e-a060-4978-9db4-f6f6f99f1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Volume b02bac9e-0d31-4994-8920-647d7d6094f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02bac9e-0d31-4994-8920-647d7d6094f1', 'volume_size': 1} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106538166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02bac9e-0d31-4994-8920-647d7d6094f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02b4be7714b4a62aa4fdda54506a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:25Z,use_quota=True,user_id='abc6af867b064661ac5764ce9a6a5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Creating volume b02bac9e-0d31-4994-8920-647d7d6094f1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:25 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:25 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 1073741824 Jul 10 19:36:25 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Flow 'volume_create_manager' (838046dc-9273-416d-8f8a-94c8b261d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf37405-177a-46f6-a3c7-3c6bbbfde314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf37405-177a-46f6-a3c7-3c6bbbfde314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1864555411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd1a2324266d43188f76594f6eb76e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:25Z,use_quota=True,user_id='0f146ba26e3b45f4bf9568c5f57efaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da0101e-f8d2-4850-bf8b-b9bbd1d48aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da0101e-f8d2-4850-bf8b-b9bbd1d48aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9f1d32-a13d-43dc-b288-62d500063ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9f1d32-a13d-43dc-b288-62d500063ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6', 'volume_name': 'volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9205fb5b-c2e9-4a20-9a38-19e6d8ed3895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9205fb5b-c2e9-4a20-9a38-19e6d8ed3895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b26401-c96c-4642-892d-b1e17a4eb66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Volume c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6', 'volume_size': 1} Jul 10 19:36:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:26 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 1073741824" returned: 0 in 1.224s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:26 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 Jul 10 19:36:26 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:27 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1" returned: 0 in 0.952s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.129s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1864555411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd1a2324266d43188f76594f6eb76e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:25Z,use_quota=True,user_id='0f146ba26e3b45f4bf9568c5f57efaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Creating volume c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:27 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:27 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 1073741824 Jul 10 19:36:27 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab24e41e-a060-4978-9db4-f6f6f99f1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02bac9e-0d31-4994-8920-647d7d6094f1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb7be61-cf17-45e9-ad1a-3c2e4df378ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Volume volume-b02bac9e-0d31-4994-8920-647d7d6094f1 (b02bac9e-0d31-4994-8920-647d7d6094f1): created successfully Jul 10 19:36:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb7be61-cf17-45e9-ad1a-3c2e4df378ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Flow 'volume_create_manager' (2bf7a48a-30c9-4cd9-a19a-cf41e1bc6b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ce8f0af9-5a7b-432f-849c-3aaa09265876 tempest-VolumesTestJSON-1978783444 None] Created volume successfully. Jul 10 19:36:29 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 1073741824" returned: 0 in 1.228s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:29 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 Jul 10 19:36:29 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:29 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Flow 'volume_create_manager' (63b0f541-72d9-40f3-a7a9-0ab0a1c36dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7c5641-951a-4a7b-8649-f8de9c206884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7c5641-951a-4a7b-8649-f8de9c206884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-95395450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe2eec9-8436-4bb7-9619-7cff55290e25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02b4be7714b4a62aa4fdda54506a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:30Z,use_quota=True,user_id='abc6af867b064661ac5764ce9a6a5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44ec3b9-0e2f-4ea8-8a24-7bb7b63e2a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44ec3b9-0e2f-4ea8-8a24-7bb7b63e2a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0e0435-e4cb-4d99-b96d-31fe526f158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0e0435-e4cb-4d99-b96d-31fe526f158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe2eec9-8436-4bb7-9619-7cff55290e25', 'volume_name': 'volume-0fe2eec9-8436-4bb7-9619-7cff55290e25', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c6c78d-b42f-4b3e-a754-7c43de9c74a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c6c78d-b42f-4b3e-a754-7c43de9c74a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7f8bec-1dd8-465d-8349-31a75b410772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:30 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Volume 0fe2eec9-8436-4bb7-9619-7cff55290e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe2eec9-8436-4bb7-9619-7cff55290e25', 'volume_size': 1} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:30 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6" returned: 0 in 1.142s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-95395450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe2eec9-8436-4bb7-9619-7cff55290e25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02b4be7714b4a62aa4fdda54506a71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:30Z,use_quota=True,user_id='abc6af867b064661ac5764ce9a6a5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Creating volume 0fe2eec9-8436-4bb7-9619-7cff55290e25 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:30 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b26401-c96c-4642-892d-b1e17a4eb66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:30 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 1073741824 Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62844160-c9c6-45fb-a4a8-3332cf8d5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:30 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:30 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Volume volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 (c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6): created successfully Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62844160-c9c6-45fb-a4a8-3332cf8d5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Flow 'volume_create_manager' (838046dc-9273-416d-8f8a-94c8b261d41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-83f7cc7d-73cf-453d-a829-5e79dc372e54 req-521ade8b-be7e-4c45-ac27-b431b3117d00 tempest-VolumesGetTestJSON-1688822891 None] Created volume successfully. Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Acquiring lock "cinder-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Lock "cinder-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:31 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 1073741824" returned: 0 in 1.444s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Acquiring lock "cinder-quobyte-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Lock "cinder-quobyte-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6" acquired by "delete_volume" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c04800-5fbb-4d00-9aba-f2e7ff80923c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:31 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 Jul 10 19:36:31 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:32 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 Jul 10 19:36:32 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:33 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25" returned: 0 in 1.205s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] <== create_volume: return (2772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.777s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7f8bec-1dd8-465d-8349-31a75b410772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe2eec9-8436-4bb7-9619-7cff55290e25', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc23a0c3-7e1a-47e3-b1c8-665962d665d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:33 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Volume volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 (0fe2eec9-8436-4bb7-9619-7cff55290e25): created successfully Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc23a0c3-7e1a-47e3-b1c8-665962d665d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Flow 'volume_create_manager' (63b0f541-72d9-40f3-a7a9-0ab0a1c36dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6712b2c2-fcd9-4e90-b8bc-7c7084f75de7 tempest-VolumesTestJSON-1978783444 None] Created volume successfully. Jul 10 19:36:33 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6" returned: 0 in 1.432s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:33 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6 Jul 10 19:36:33 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:34 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Lock "cinder-quobyte-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6" released by "delete_volume" :: held 2.304s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG cinder.quota [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Created reservations ['cb29b441-8a78-439f-85f5-bb0f53533f91', 'bd93c87c-9a94-4043-8a72-45788a8c5248', '1114ae53-594d-4f4a-bf7d-bf3e8098793a', 'a17f9167-7ba8-45b5-a060-733596046387'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:34 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:34 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:35 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.305s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:35 devstack cinder-volume[87164]: DEBUG cinder.manager [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:35 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Deleted volume successfully. Jul 10 19:36:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-04e58bc9-48e3-4f3e-8cdf-81e32663f2d8 req-bb4be050-8fdc-4b72-b5f0-d24304fdee90 tempest-VolumesGetTestJSON-1688822891 None] Lock "cinder-c02d5a9b-bfc3-449c-b450-5aa82b9ef2c6-delete_volume" released by "delete_volume" :: held 4.139s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "cinder-0fe2eec9-8436-4bb7-9619-7cff55290e25-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-0fe2eec9-8436-4bb7-9619-7cff55290e25-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "cinder-quobyte-0fe2eec9-8436-4bb7-9619-7cff55290e25" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-quobyte-0fe2eec9-8436-4bb7-9619-7cff55290e25" acquired by "delete_volume" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:36 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e51906-0b60-4aa8-a57a-90dcccbb9dba]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:36 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 Jul 10 19:36:36 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:37 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:37 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:37 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25" returned: 0 in 1.242s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:37 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25 Jul 10 19:36:37 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:38 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fe2eec9-8436-4bb7-9619-7cff55290e25" returned: 0 in 1.204s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-quobyte-0fe2eec9-8436-4bb7-9619-7cff55290e25" released by "delete_volume" :: held 2.574s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:38 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=56,cinder:UPDATE=61,cinder:INSERT=8,cinder:DELETE=7 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:36:38 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.474s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=52,cinder:UPDATE=70,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 8 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Created reservations ['4cc823be-1009-4ad6-8487-f810f3235457', 'c95d64f8-f9b4-475b-b4f1-a26e694aaffc', 'bba0b66f-1308-4552-ba9c-3c8675ae7275', '746ecf84-170a-4650-bc09-96be259aa491'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:39 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:39 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "cinder-b02bac9e-0d31-4994-8920-647d7d6094f1-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-b02bac9e-0d31-4994-8920-647d7d6094f1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "cinder-quobyte-b02bac9e-0d31-4994-8920-647d7d6094f1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-quobyte-b02bac9e-0d31-4994-8920-647d7d6094f1" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c985fb0e-08ff-4ad0-8f0d-e5012b798596]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:40 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 Jul 10 19:36:40 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:40 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.886s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:40 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Deleted volume successfully. Jul 10 19:36:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9376c5c-b7fb-4de4-ba1f-730f6a33e7b3 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-0fe2eec9-8436-4bb7-9619-7cff55290e25-delete_volume" released by "delete_volume" :: held 4.008s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:40 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1" returned: 0 in 0.923s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:40 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1 Jul 10 19:36:40 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:41 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b02bac9e-0d31-4994-8920-647d7d6094f1" returned: 0 in 0.686s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-quobyte-b02bac9e-0d31-4994-8920-647d7d6094f1" released by "delete_volume" :: held 1.657s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Created reservations ['bd88bfeb-28ec-42a8-b75b-729f8f680a1a', '18db21d1-95d1-46c7-be98-af50409ba733', '8f237d28-a24c-4370-8ad3-8c9529d382f6', '32b8847b-a5e6-4cac-b5f0-c5033ea7ef1a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:41 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:41 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Acquiring lock "cinder-1428568d-c777-42bf-9656-487bf94d5502-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8ee7850c-bd14-41b4-b7f9-5341f3e79e03 tempest-GroupSnapshotsV319Test-326787733 None] Group tempest-GroupSnapshotsV319Test-Group-1903443501: creating Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Lock "cinder-1428568d-c777-42bf-9656-487bf94d5502-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8ee7850c-bd14-41b4-b7f9-5341f3e79e03 tempest-GroupSnapshotsV319Test-326787733 None] Group tempest-GroupSnapshotsV319Test-Group-1903443501: created successfully Jul 10 19:36:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8ee7850c-bd14-41b4-b7f9-5341f3e79e03 tempest-GroupSnapshotsV319Test-326787733 None] Create group completed successfully. Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Acquiring lock "cinder-quobyte-1428568d-c777-42bf-9656-487bf94d5502" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Lock "cinder-quobyte-1428568d-c777-42bf-9656-487bf94d5502" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[77117f38-8927-4b77-8e95-b7cbf2f553a9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:42 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 Jul 10 19:36:42 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:42 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.756s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Deleted volume successfully. Jul 10 19:36:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a01d8ee3-a6c2-4d76-b8e4-8dd93a5033e9 tempest-VolumesTestJSON-1978783444 None] Lock "cinder-b02bac9e-0d31-4994-8920-647d7d6094f1-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:43 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502" returned: 0 in 0.790s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:43 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502 Jul 10 19:36:43 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:43 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1428568d-c777-42bf-9656-487bf94d5502" returned: 0 in 0.690s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Lock "cinder-quobyte-1428568d-c777-42bf-9656-487bf94d5502" released by "delete_volume" :: held 1.540s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Flow 'volume_create_manager' (3b3cf717-c79b-4e9d-9b00-706161822e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de21197f-9df8-4b65-8944-e0998d9327fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de21197f-9df8-4b65-8944-e0998d9327fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353285711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8307f48f-b250-469f-a0f7-287ae24db1ca,host='devstack@QuobyteHD#QuobyteHD',id=dc0c6b2d-2914-415d-a6dc-a0eab2652592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b07640212045cd86b3462620d8cbf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:44Z,use_quota=True,user_id='41f4c4b2ce914e499fa209dabbec7644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f6ffdc8-8a91-4492-bd6b-5ca2a55c3ac7),volume_type_id=1f6ffdc8-8a91-4492-bd6b-5ca2a55c3ac7)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba007951-ecba-4483-8910-da4d542aa219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba007951-ecba-4483-8910-da4d542aa219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4efb0b-a9b5-4e4a-bbc3-2fe4250cf805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4efb0b-a9b5-4e4a-bbc3-2fe4250cf805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0c6b2d-2914-415d-a6dc-a0eab2652592', 'volume_name': 'volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bc2151-5043-4434-b729-a6aab483f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bc2151-5043-4434-b729-a6aab483f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f16374-ff55-4d9e-8156-886602ee81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Volume dc0c6b2d-2914-415d-a6dc-a0eab2652592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592', 'volume_size': 1} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8307f48f-b250-469f-a0f7-287ae24db1ca,created_at=2026-07-10T17:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353285711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8307f48f-b250-469f-a0f7-287ae24db1ca,host='devstack@QuobyteHD#QuobyteHD',id=dc0c6b2d-2914-415d-a6dc-a0eab2652592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b07640212045cd86b3462620d8cbf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:44Z,use_quota=True,user_id='41f4c4b2ce914e499fa209dabbec7644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f6ffdc8-8a91-4492-bd6b-5ca2a55c3ac7),volume_type_id=1f6ffdc8-8a91-4492-bd6b-5ca2a55c3ac7)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Creating volume dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:43 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:43 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 1073741824 Jul 10 19:36:43 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:43 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Created reservations ['f38e69b0-fe6d-48ef-b400-2827632f6b53', 'db8e69b2-aff1-42d8-8ad9-9ac57e256615', '554331c0-f2b0-4916-9b53-f1775047636c', '24752d6c-64ce-4db1-a1d9-14b25f3c39ab'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:44 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:36:44 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:44 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.904s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:44 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:36:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Deleted volume successfully. Jul 10 19:36:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3f0704d2-55b4-4e0e-84e5-98e6a715b50b tempest-VolumesTestJSON-1978783444 None] Lock "cinder-1428568d-c777-42bf-9656-487bf94d5502-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:45 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 1073741824" returned: 0 in 1.264s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:45 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 Jul 10 19:36:45 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:46 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592" returned: 0 in 0.789s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f16374-ff55-4d9e-8156-886602ee81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fa6e10-892c-4508-8566-43a181903536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:46 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Volume volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 (dc0c6b2d-2914-415d-a6dc-a0eab2652592): created successfully Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fa6e10-892c-4508-8566-43a181903536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Flow 'volume_create_manager' (3b3cf717-c79b-4e9d-9b00-706161822e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-21895100-1751-4650-b047-e334f8902e49 tempest-GroupSnapshotsV319Test-326787733 None] Created volume successfully. Jul 10 19:36:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] GroupSnapshot e24bc524-fed4-405a-be9b-5a8552ef3989: creating. Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Group snapshot e24bc524-fed4-405a-be9b-5a8552ef3989: creating. {{(pid=87164) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Creating offline snapshot 526b2511-f171-4b53-a8ec-96182f842bcf of volume dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24bee6-21a7-4b80-a75e-af6f923fa418]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:46 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 Jul 10 19:36:46 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:47 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592" returned: 0 in 1.012s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:47 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf 1G Jul 10 19:36:47 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:49 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf 1G" returned: 0 in 1.406s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:49 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf Jul 10 19:36:49 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:50 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf" returned: 0 in 0.944s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:50 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:36:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:50 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf Jul 10 19:36:50 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2f289d53-8be8-4e23-8794-41e2201bbb3b tempest-GroupSnapshotsTest-283473984 None] Group tempest-GroupSnapshotsTest-Group-2100004915: creating Jul 10 19:36:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2f289d53-8be8-4e23-8794-41e2201bbb3b tempest-GroupSnapshotsTest-283473984 None] Group tempest-GroupSnapshotsTest-Group-2100004915: created successfully Jul 10 19:36:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2f289d53-8be8-4e23-8794-41e2201bbb3b tempest-GroupSnapshotsTest-283473984 None] Create group completed successfully. Jul 10 19:36:50 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf" returned: 0 in 0.741s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:50 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info Jul 10 19:36:50 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:51 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info" returned: 0 in 0.709s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:51 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:36:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:51 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info Jul 10 19:36:51 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (8f13aa48-47e4-4ca1-96e8-ff18cbb0ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb798cce-4952-4cbf-9897-975ff5368dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.info" returned: 0 in 0.819s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.722s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb798cce-4952-4cbf-9897-975ff5368dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1891297396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ec7b817-3761-4d67-88f2-3693b52fe617,host='devstack@QuobyteHD#QuobyteHD',id=5b488149-46b3-4084-b869-1244cf5df368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:52Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40358a9d-44f7-48dc-9f8d-d3526921e9b8),volume_type_id=40358a9d-44f7-48dc-9f8d-d3526921e9b8)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef43ecaf-f640-4f06-abba-522b9ae6a887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef43ecaf-f640-4f06-abba-522b9ae6a887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c3a932-641b-4480-ba10-4e6a73807c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c3a932-641b-4480-ba10-4e6a73807c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b488149-46b3-4084-b869-1244cf5df368', 'volume_name': 'volume-5b488149-46b3-4084-b869-1244cf5df368', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221860dd-72dc-4eae-8c9e-1710c38c88a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221860dd-72dc-4eae-8c9e-1710c38c88a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bcae93-f15b-46ee-bb7f-b921cd030ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Volume 5b488149-46b3-4084-b869-1244cf5df368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b488149-46b3-4084-b869-1244cf5df368', 'volume_size': 1} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ec7b817-3761-4d67-88f2-3693b52fe617,created_at=2026-07-10T17:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1891297396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ec7b817-3761-4d67-88f2-3693b52fe617,host='devstack@QuobyteHD#QuobyteHD',id=5b488149-46b3-4084-b869-1244cf5df368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:52Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40358a9d-44f7-48dc-9f8d-d3526921e9b8),volume_type_id=40358a9d-44f7-48dc-9f8d-d3526921e9b8)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Creating volume 5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:52 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:52 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 1073741824 Jul 10 19:36:52 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Flow 'volume_create_manager' (5d52b7ff-8a0a-4642-9276-f32e897e4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67676d87-ebd7-44a7-a275-1e399dffd73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67676d87-ebd7-44a7-a275-1e399dffd73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-743600775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88aae575-adac-47d8-81e3-3034cb1a35a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8518d751988d4ae2aded34d4cd638d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:52Z,use_quota=True,user_id='3f406d043d8d41d4b42a7ececdef3a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98574cee-7bbc-4df9-a025-f91a85c84e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98574cee-7bbc-4df9-a025-f91a85c84e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b16373a-d5ee-4f80-a0d5-9271f8c0ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b16373a-d5ee-4f80-a0d5-9271f8c0ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88aae575-adac-47d8-81e3-3034cb1a35a0', 'volume_name': 'volume-88aae575-adac-47d8-81e3-3034cb1a35a0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be968e08-ddb1-4174-9869-8f2be7143b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be968e08-ddb1-4174-9869-8f2be7143b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec2506c-4206-43de-84b1-ca9607d48e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Volume 88aae575-adac-47d8-81e3-3034cb1a35a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88aae575-adac-47d8-81e3-3034cb1a35a0', 'volume_size': 1} Jul 10 19:36:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-945d5aab-c2a5-4845-b590-57077f86c18c tempest-GroupSnapshotsV319Test-326787733 None] group_snapshot e24bc524-fed4-405a-be9b-5a8552ef3989: created successfully Jul 10 19:36:53 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 1073741824" returned: 0 in 0.854s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:53 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:36:53 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:53 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] group_snapshot e24bc524-fed4-405a-be9b-5a8552ef3989: deleting Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] group_snapshot e24bc524-fed4-405a-be9b-5a8552ef3989: deleting {{(pid=87164) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "cinder-quobyte-dc0c6b2d-2914-415d-a6dc-a0eab2652592" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Lock "cinder-quobyte-dc0c6b2d-2914-415d-a6dc-a0eab2652592" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "cinder-quobyte-526b2511-f171-4b53-a8ec-96182f842bcf" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Lock "cinder-quobyte-526b2511-f171-4b53-a8ec-96182f842bcf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Deleting offline snapshot 526b2511-f171-4b53-a8ec-96182f842bcf of volume dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] snapshot_file for this snap is: volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b18975-85fb-4cc0-b8bb-bf3520ed1e38]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:53 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf Jul 10 19:36:53 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:54 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-743600775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88aae575-adac-47d8-81e3-3034cb1a35a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8518d751988d4ae2aded34d4cd638d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:36:52Z,use_quota=True,user_id='3f406d043d8d41d4b42a7ececdef3a28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Creating volume 88aae575-adac-47d8-81e3-3034cb1a35a0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:36:54 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:54 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 1073741824 Jul 10 19:36:54 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bcae93-f15b-46ee-bb7f-b921cd030ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b488149-46b3-4084-b869-1244cf5df368', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fb76e9-1b73-467a-9ffb-66b951f3793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Volume volume-5b488149-46b3-4084-b869-1244cf5df368 (5b488149-46b3-4084-b869-1244cf5df368): created successfully Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fb76e9-1b73-467a-9ffb-66b951f3793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (8f13aa48-47e4-4ca1-96e8-ff18cbb0ba62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2d12ebdc-8f4a-4477-8e93-eb1afe29a301 tempest-GroupSnapshotsTest-283473984 None] Created volume successfully. Jul 10 19:36:54 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf" returned: 0 in 0.808s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b1252c-92f4-424d-9577-058fe12e5713]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:54 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 Jul 10 19:36:54 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:54 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] GroupSnapshot e2d7c139-5069-46e0-97d7-40985631dd17: creating. Jul 10 19:36:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 1073741824" returned: 0 in 0.928s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Group snapshot e2d7c139-5069-46e0-97d7-40985631dd17: creating. {{(pid=87164) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:55 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 Jul 10 19:36:55 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:36:55 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592" returned: 0 in 0.851s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:55 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf Jul 10 19:36:55 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:55 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.675s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec2506c-4206-43de-84b1-ca9607d48e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88aae575-adac-47d8-81e3-3034cb1a35a0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7736441d-bf38-44c7-b1e8-ce569641dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Creating offline snapshot 858fc046-eec0-4423-a7bf-f379a43ce134 of volume 5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:36:55 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Volume volume-88aae575-adac-47d8-81e3-3034cb1a35a0 (88aae575-adac-47d8-81e3-3034cb1a35a0): created successfully Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7736441d-bf38-44c7-b1e8-ce569641dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Flow 'volume_create_manager' (5d52b7ff-8a0a-4642-9276-f32e897e4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dbc8a7-b66d-418b-99d8-79aab7822c7e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:55 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1f909251-1665-4490-aa6f-2d377e42a70d tempest-TaggedAttachmentsTest-1248966858 None] Created volume successfully. Jul 10 19:36:55 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:36:55 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:56 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf" returned: 0 in 0.732s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:56 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf Jul 10 19:36:56 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:56 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 0.757s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:56 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 1G Jul 10 19:36:56 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:56 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592.526b2511-f171-4b53-a8ec-96182f842bcf" returned: 0 in 0.683s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Lock "cinder-quobyte-526b2511-f171-4b53-a8ec-96182f842bcf" released by "_delete_snapshot" :: held 3.192s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Lock "cinder-quobyte-dc0c6b2d-2914-415d-a6dc-a0eab2652592" released by "delete_snapshot" :: held 3.225s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:36:57 devstack cinder-volume[87164]: WARNING cinder.quota [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1067522307 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1067522307, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:36:57 devstack cinder-volume[87164]: WARNING cinder.quota [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1067522307 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1067522307, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:36:57 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] Created reservations ['f806d1c7-8544-47f1-91dd-ae1c5ebf0f18', '6fad9282-4de0-4fa7-9f4b-08be164b6e77', 'f0820bf5-d5ee-4544-b19e-e727ce29321b', '0c38a0df-7558-420a-9840-aedcabdb7fe5'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:36:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-01048359-074a-46cd-b3bf-3a1d5735a175 tempest-GroupSnapshotsV319Test-326787733 None] group_snapshot e24bc524-fed4-405a-be9b-5a8552ef3989: deleted successfully Jul 10 19:36:57 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 1G" returned: 0 in 0.894s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b488149-46b3-4084-b869-1244cf5df368 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:57 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b488149-46b3-4084-b869-1244cf5df368 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 Jul 10 19:36:57 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:58 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b488149-46b3-4084-b869-1244cf5df368 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134" returned: 0 in 0.780s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:58 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:58 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 Jul 10 19:36:58 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "cinder-quobyte-dc0c6b2d-2914-415d-a6dc-a0eab2652592" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Lock "cinder-quobyte-dc0c6b2d-2914-415d-a6dc-a0eab2652592" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[155e3473-e170-4da3-9717-aa2af95fd3d0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:58 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 Jul 10 19:36:58 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:58 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134" returned: 0 in 0.707s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:58 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info Jul 10 19:36:58 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:59 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592" returned: 0 in 0.851s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:59 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592 Jul 10 19:36:59 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:36:59 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Jul 10 19:36:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info" returned: 0 in 0.700s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:36:59 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:36:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:36:59 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info Jul 10 19:36:59 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:00 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-dc0c6b2d-2914-415d-a6dc-a0eab2652592" returned: 0 in 0.725s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Lock "cinder-quobyte-dc0c6b2d-2914-415d-a6dc-a0eab2652592" released by "delete_volume" :: held 1.642s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Created reservations ['70926d1e-1e44-4a18-8a5d-65e6c704eb28'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:00 devstack cinder-volume[87164]: WARNING cinder.quota [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1067522307 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1067522307, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Created reservations ['9abb520c-e4c2-423f-b404-5b4ac5a10f29', 'f8488b5a-32ab-4d7b-8c41-5458969efa2b', '2447f49a-bdd7-4b86-b109-1396813ea3e0', '29f077ab-8792-40cf-9b4a-5b94f79bb9d3'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:00 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:37:00 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:00 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.info" returned: 0 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.166s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f4bf64-83c5-4707-9c9e-c9a07bc01908]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-fa7e7f3c-cb97-46b3-99b6-f66e7ab35023 tempest-GroupSnapshotsTest-283473984 None] group_snapshot e2d7c139-5069-46e0-97d7-40985631dd17: created successfully Jul 10 19:37:00 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 Jul 10 19:37:00 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:01 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:01 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:37:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7b94e820-33dc-4872-8c58-1f74a47e1ed4 tempest-GroupSnapshotsV319Test-326787733 None] Delete group completed successfully. Jul 10 19:37:01 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" returned: 0 in 0.872s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0d98615-f750-455e-aee5-7048d38454b8', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:37:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-66cc77fe-8a26-4d4b-b8e3-a33497d1d2ad req-701d9794-67f7-4f0d-96f3-67a2cdeb4d42 tempest-ServerActionsTestOtherA-1691401630 None] attachment_update completed successfully. Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-858fc046-eec0-4423-a7bf-f379a43ce134-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-858fc046-eec0-4423-a7bf-f379a43ce134-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Creating volume 9aeea20f-101e-4bac-b3ac-0fd5f21604f6 from snapshot 858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] snapshot: 858fc046-eec0-4423-a7bf-f379a43ce134, volume: 9aeea20f-101e-4bac-b3ac-0fd5f21604f6, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e718d366-a758-4085-95c7-838c5a91ddbf]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:02 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 Jul 10 19:37:02 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:03 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134" returned: 0 in 0.869s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b488149-46b3-4084-b869-1244cf5df368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:37:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:37:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:37:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f66a4-8605-4571-acdc-a0bf5e442a7f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:03 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:37:03 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:04 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:04 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:37:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:04 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 Jul 10 19:37:04 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-299ab27a-30f1-4a5c-87af-b3feb23d8d08 tempest-GroupsV314Test-717487271 None] Group tempest-GroupsV314Test-Group-464390853: creating Jul 10 19:37:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-299ab27a-30f1-4a5c-87af-b3feb23d8d08 tempest-GroupsV314Test-717487271 None] Group tempest-GroupsV314Test-Group-464390853: created successfully Jul 10 19:37:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-299ab27a-30f1-4a5c-87af-b3feb23d8d08 tempest-GroupsV314Test-717487271 None] Create group completed successfully. Jul 10 19:37:10 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:37:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Flow 'volume_create_manager' (42f15c23-bd15-4749-bf70-2ae69976a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:37:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f63db7-ab59-4bb5-b099-db316389481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f63db7-ab59-4bb5-b099-db316389481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-175661483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d6bdc21-08bd-4e0b-9309-0b5f38920969,host='devstack@QuobyteHD#QuobyteHD',id=582525f3-adf4-4da3-af53-6a827da14ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='748c42c85d42459abdffc7618bbc35a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:37:11Z,use_quota=True,user_id='3e0a2610ff424c2ba40d47696c00d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4f427a-10e8-45f9-9452-c4a509a51944),volume_type_id=ea4f427a-10e8-45f9-9452-c4a509a51944)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62815c35-9668-46cd-95c6-313408fe74b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62815c35-9668-46cd-95c6-313408fe74b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e47c38-ac94-43c9-9ef9-5389a0a0921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e47c38-ac94-43c9-9ef9-5389a0a0921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582525f3-adf4-4da3-af53-6a827da14ab1', 'volume_name': 'volume-582525f3-adf4-4da3-af53-6a827da14ab1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2aa05a-cb17-425c-8825-9c41e3222f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2aa05a-cb17-425c-8825-9c41e3222f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e98624-98df-43c3-9cb0-a60bd9ec55af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:11 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Volume 582525f3-adf4-4da3-af53-6a827da14ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582525f3-adf4-4da3-af53-6a827da14ab1', 'volume_size': 1} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:11 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" returned: 0 in 7.112s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e6eab2-1ad1-4d3a-8916-71ac630cbe29]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:11 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:37:11 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:11 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-c6b08419-e798-43c7-bfea-e9c87ba4f1a5 tempest-ServerActionsTestOtherA-1691401630 None] Terminate volume connection completed successfully. Jul 10 19:37:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-c6b08419-e798-43c7-bfea-e9c87ba4f1a5 tempest-ServerActionsTestOtherA-1691401630 None] Deleting attachment e0d98615-f750-455e-aee5-7048d38454b8. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:37:12 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 0.977s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:12 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:37:12 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Converted 1024.00 MB image at 143.94 MB/s Jul 10 19:37:12 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:12 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 Jul 10 19:37:12 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:13 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" returned: 0 in 0.958s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" released by "_copy_volume_from_snapshot" :: held 10.910s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-858fc046-eec0-4423-a7bf-f379a43ce134-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" released by "_create_volume_from_snapshot" :: held 10.967s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.489s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d6bdc21-08bd-4e0b-9309-0b5f38920969,created_at=2026-07-10T17:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-175661483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d6bdc21-08bd-4e0b-9309-0b5f38920969,host='devstack@QuobyteHD#QuobyteHD',id=582525f3-adf4-4da3-af53-6a827da14ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='748c42c85d42459abdffc7618bbc35a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:37:11Z,use_quota=True,user_id='3e0a2610ff424c2ba40d47696c00d10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4f427a-10e8-45f9-9452-c4a509a51944),volume_type_id=ea4f427a-10e8-45f9-9452-c4a509a51944)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Creating volume 582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:37:13 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:37:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:13 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 1073741824 Jul 10 19:37:13 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:13 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a39896c5-1960-4e06-951b-d14599bfef11 tempest-GroupSnapshotsTest-283473984 None] Create group from source-snapshot-e2d7c139-5069-46e0-97d7-40985631dd17 completed successfully. Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd3c0a-466e-4be4-a28c-3ee8f44b639e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:14 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 1073741824" returned: 0 in 1.192s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:14 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:14 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:14 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 Jul 10 19:37:14 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:15 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 0.707s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.086s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e98624-98df-43c3-9cb0-a60bd9ec55af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582525f3-adf4-4da3-af53-6a827da14ab1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d0415d-512a-4e31-ab55-1f4c8b2b8810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8dde99-b382-4832-af96-928d33b54d4c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Volume volume-582525f3-adf4-4da3-af53-6a827da14ab1 (582525f3-adf4-4da3-af53-6a827da14ab1): created successfully Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d0415d-512a-4e31-ab55-1f4c8b2b8810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:15 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Flow 'volume_create_manager' (42f15c23-bd15-4749-bf70-2ae69976a6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" returned: 0 in 0.884s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-82014a58-0215-4220-8608-95451609848f tempest-GroupsV314Test-717487271 None] Created volume successfully. Jul 10 19:37:15 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6 Jul 10 19:37:15 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:15 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 Jul 10 19:37:15 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:16 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" returned: 0 in 0.877s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-9aeea20f-101e-4bac-b3ac-0fd5f21604f6" released by "delete_volume" :: held 1.811s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['7479aef5-c9a6-4a3b-9848-37d26fcd9b76'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:16 devstack cinder-volume[87164]: WARNING cinder.quota [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1991591181 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1991591181, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:37:16 devstack cinder-volume[87164]: WARNING cinder.quota [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1991591181 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1991591181, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['a037be36-d902-4a63-ade9-f8d3b3d59075', '85ba655b-d926-4a83-9058-88698fda4a51', 'd7c0b4f4-a886-4c75-9938-89b7a535b8ae', 'e36ec102-91ed-4de0-8634-b0cebd754ca4'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:16 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" returned: 0 in 1.141s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.189s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3be1274e-8a84-4ea8-9536-99bc5b1321b1', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:37:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-9afcd804-ceeb-491e-abc7-15c21e97e4be req-5527e3ea-eb71-4a11-ab47-4c3c04a8286b tempest-ServerActionsTestOtherA-1691401630 None] attachment_update completed successfully. Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:16 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:37:16 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] group_snapshot e2d7c139-5069-46e0-97d7-40985631dd17: deleting Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] group_snapshot e2d7c139-5069-46e0-97d7-40985631dd17: deleting {{(pid=87164) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-5b488149-46b3-4084-b869-1244cf5df368" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-5b488149-46b3-4084-b869-1244cf5df368" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-858fc046-eec0-4423-a7bf-f379a43ce134" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-858fc046-eec0-4423-a7bf-f379a43ce134" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Deleting offline snapshot 858fc046-eec0-4423-a7bf-f379a43ce134 of volume 5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] snapshot_file for this snap is: volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f32d2-76eb-4680-8bbc-1ab804459f20]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:17 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 Jul 10 19:37:17 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:17 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.042s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:17 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:37:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dc2818cd-79f3-4315-adc8-ce612bb108a0 tempest-GroupSnapshotsTest-283473984 None] Delete group completed successfully. Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:18 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Cloning volume 582525f3-adf4-4da3-af53-6a827da14ab1 to volume 019d4f24-49fa-4337-bdf6-fb844df75e26 Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Creating offline snapshot e7302e93-12b0-4fea-8593-7dda0dbed081 of volume 582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4310b78b-da2c-4171-9e2b-e011b4a00a8e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:18 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:18 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:18 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134" returned: 0 in 1.183s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b488149-46b3-4084-b869-1244cf5df368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f623ce15-c3cb-41bb-9ec5-531529da6108]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:18 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:37:18 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:19 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 1.391s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:19 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 1G Jul 10 19:37:19 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:20 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 1.343s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:20 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 Jul 10 19:37:20 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:21 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 1G" returned: 0 in 1.458s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-582525f3-adf4-4da3-af53-6a827da14ab1 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:21 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-582525f3-adf4-4da3-af53-6a827da14ab1 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 Jul 10 19:37:21 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:21 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134" returned: 0 in 1.369s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:21 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134 Jul 10 19:37:21 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:22 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-582525f3-adf4-4da3-af53-6a827da14ab1 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081" returned: 0 in 0.990s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:22 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:22 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 Jul 10 19:37:22 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:22 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368.858fc046-eec0-4423-a7bf-f379a43ce134" returned: 0 in 1.290s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-858fc046-eec0-4423-a7bf-f379a43ce134" released by "_delete_snapshot" :: held 5.359s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-5b488149-46b3-4084-b869-1244cf5df368" released by "delete_snapshot" :: held 5.403s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:22 devstack cinder-volume[87164]: WARNING cinder.quota [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1991591181 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1991591181, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:37:22 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] Created reservations ['386a3052-8b57-42ca-ae95-f07d5bca8adf', '116ae5c4-78b0-45b1-ae71-8c9031246676', '4a95b40a-0867-426c-8953-c0035e622059', '860d7fae-9b33-4d15-9933-c0c7415be118'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:23 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3e4252ca-a604-476b-abcd-df098c3c006e tempest-GroupSnapshotsTest-283473984 None] group_snapshot e2d7c139-5069-46e0-97d7-40985631dd17: deleted successfully Jul 10 19:37:23 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081" returned: 0 in 0.830s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:23 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info Jul 10 19:37:23 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-5b488149-46b3-4084-b869-1244cf5df368" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-5b488149-46b3-4084-b869-1244cf5df368" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcf36e7-f522-4f87-8f5d-555e7a57c417]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:23 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:37:23 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:24 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info" returned: 0 in 0.979s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:24 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:24 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info Jul 10 19:37:24 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:24 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 1.128s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:24 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368 Jul 10 19:37:24 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:25 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.info" returned: 0 in 1.005s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Acquiring lock "cinder-quobyte-019d4f24-49fa-4337-bdf6-fb844df75e26" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-019d4f24-49fa-4337-bdf6-fb844df75e26" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] snapshot: e7302e93-12b0-4fea-8593-7dda0dbed081, volume: 019d4f24-49fa-4337-bdf6-fb844df75e26, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76c3c6-b68a-4506-a980-246be285e826]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:25 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 Jul 10 19:37:25 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:25 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5b488149-46b3-4084-b869-1244cf5df368" returned: 0 in 1.098s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-5b488149-46b3-4084-b869-1244cf5df368" released by "delete_volume" :: held 2.301s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['19062548-5b65-4f0b-b5c0-1c2c3a69601a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:25 devstack cinder-volume[87164]: WARNING cinder.db.api [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1991591181'] Jul 10 19:37:25 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['ff52244a-68ea-46f0-be97-34786a960043', 'cd99bfab-a5c6-4a35-9448-59850cf485b5', '20d6727d-0493-4310-be03-92ba5390f551', '2f0476e3-099c-465c-9bb2-d45f92e3c7dd'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:26 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:37:26 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-75fd33d7-781c-41cf-80e3-d93093076a19 tempest-GroupSnapshotsTest-283473984 None] Group tempest-GroupSnapshotsTest-Group-1739014705: creating Jul 10 19:37:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-75fd33d7-781c-41cf-80e3-d93093076a19 tempest-GroupSnapshotsTest-283473984 None] Group tempest-GroupSnapshotsTest-Group-1739014705: created successfully Jul 10 19:37:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-75fd33d7-781c-41cf-80e3-d93093076a19 tempest-GroupSnapshotsTest-283473984 None] Create group completed successfully. Jul 10 19:37:27 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081" returned: 0 in 1.798s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-582525f3-adf4-4da3-af53-6a827da14ab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a04e8fa-b428-4f0f-8011-9f05d8a35fe1]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:27 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:27 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:27 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.309s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:27 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:37:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ca34bb56-4034-464e-a4b2-4b42e37076d3 tempest-GroupSnapshotsTest-283473984 None] Delete group completed successfully. Jul 10 19:37:28 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 1.099s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:28 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 Jul 10 19:37:28 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (e8a18ac6-cd46-4255-8f8b-8332c3f6bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9172db86-cd62-4f57-a499-0f3410e2adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9172db86-cd62-4f57-a499-0f3410e2adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095514486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efa6c02-6a1d-446d-87ea-fa82397ed3e0,host='devstack@QuobyteHD#QuobyteHD',id=255a5677-e84a-4a7b-a724-c0bcbf8b3438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:37:29Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f7de0c9-fa1f-4b62-9194-d0284d74208a),volume_type_id=1f7de0c9-fa1f-4b62-9194-d0284d74208a)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4f48df-ce35-4c7e-9c07-f4d455a94735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4f48df-ce35-4c7e-9c07-f4d455a94735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e8bb96-79e3-4c50-9bc1-9d604d6e7b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e8bb96-79e3-4c50-9bc1-9d604d6e7b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255a5677-e84a-4a7b-a724-c0bcbf8b3438', 'volume_name': 'volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61e9a04-1b38-4f9c-9f3c-cc5a3e6451ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61e9a04-1b38-4f9c-9f3c-cc5a3e6451ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb21778-ffad-4ad6-bc44-332a5c290a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:28 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Volume 255a5677-e84a-4a7b-a724-c0bcbf8b3438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438', 'volume_size': 1} Jul 10 19:37:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:35 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26" returned: 0 in 7.117s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:35 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704c102-280a-4a9e-b165-d4b19d03c6cf]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:35 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:35 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:36 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 0.954s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:36 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1, size 1024.00 MB, duration 7.12 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:37:36 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Converted 1024.00 MB image at 143.86 MB/s Jul 10 19:37:36 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:36 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 Jul 10 19:37:36 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:37 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26" returned: 0 in 0.695s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-019d4f24-49fa-4337-bdf6-fb844df75e26" released by "_copy_volume_from_snapshot" :: held 11.802s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Acquiring lock "cinder-quobyte-e7302e93-12b0-4fea-8593-7dda0dbed081" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-e7302e93-12b0-4fea-8593-7dda0dbed081" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Deleting offline snapshot e7302e93-12b0-4fea-8593-7dda0dbed081 of volume 582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] snapshot_file for this snap is: volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[067f493d-90d5-42c4-839a-5ac66d2d2b2f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:37 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 Jul 10 19:37:37 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:37 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:37:37 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:38 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081" returned: 0 in 1.118s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-582525f3-adf4-4da3-af53-6a827da14ab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8a18b-961f-45c8-b282-b77b0246b7ca]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:38 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.979s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:37:38 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:38 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:38 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=97,cinder:INSERT=23,cinder:UPDATE=105,cinder:DELETE=3 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:37:39 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 1.138s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:39 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 Jul 10 19:37:39 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:40 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081" returned: 0 in 0.728s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:40 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081 Jul 10 19:37:40 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:40 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1.e7302e93-12b0-4fea-8593-7dda0dbed081" returned: 0 in 0.668s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-e7302e93-12b0-4fea-8593-7dda0dbed081" released by "_delete_snapshot" :: held 3.824s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=83,cinder:SELECT=104,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.608s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.041s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2efa6c02-6a1d-446d-87ea-fa82397ed3e0,created_at=2026-07-10T17:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095514486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efa6c02-6a1d-446d-87ea-fa82397ed3e0,host='devstack@QuobyteHD#QuobyteHD',id=255a5677-e84a-4a7b-a724-c0bcbf8b3438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:37:29Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f7de0c9-fa1f-4b62-9194-d0284d74208a),volume_type_id=1f7de0c9-fa1f-4b62-9194-d0284d74208a)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Creating volume 255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:37:40 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:37:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:41 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 1073741824 Jul 10 19:37:41 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-505cff23-8766-4c35-963b-9f634752528f tempest-GroupsV314Test-717487271 None] Create group from source-group-1d6bdc21-08bd-4e0b-9309-0b5f38920969 completed successfully. Jul 10 19:37:41 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 1073741824" returned: 0 in 0.814s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:41 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 Jul 10 19:37:41 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:42 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438" returned: 0 in 0.664s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb21778-ffad-4ad6-bc44-332a5c290a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f76f811-a4d2-4c2f-91a8-d1afbf620b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:42 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Volume volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 (255a5677-e84a-4a7b-a724-c0bcbf8b3438): created successfully Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f76f811-a4d2-4c2f-91a8-d1afbf620b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (e8a18ac6-cd46-4255-8f8b-8332c3f6bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:37:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ec739307-1c04-45bc-ab25-0a707a6f4069 tempest-GroupSnapshotsTest-283473984 None] Created volume successfully. Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Acquiring lock "cinder-quobyte-019d4f24-49fa-4337-bdf6-fb844df75e26" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-019d4f24-49fa-4337-bdf6-fb844df75e26" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b4a0d3-8e94-4e43-9d24-756839430749]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:42 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 Jul 10 19:37:42 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:43 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26" returned: 0 in 0.806s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:43 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26 Jul 10 19:37:43 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (9439e550-8a24-48f0-b6d9-1e82a88682a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc369ed5-37e2-4c20-930b-7102962ff62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc369ed5-37e2-4c20-930b-7102962ff62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716300864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efa6c02-6a1d-446d-87ea-fa82397ed3e0,host='devstack@QuobyteHD#QuobyteHD',id=d98fd572-de0f-456c-a4a9-69a759870d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:37:44Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f7de0c9-fa1f-4b62-9194-d0284d74208a),volume_type_id=1f7de0c9-fa1f-4b62-9194-d0284d74208a)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f85330-998e-450c-b39c-5fac744bdd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f85330-998e-450c-b39c-5fac744bdd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a70738-7705-4f3f-b903-5d1c2ebcad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a70738-7705-4f3f-b903-5d1c2ebcad3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98fd572-de0f-456c-a4a9-69a759870d82', 'volume_name': 'volume-d98fd572-de0f-456c-a4a9-69a759870d82', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c707d54-4c6f-4fba-aa7c-fab5d314dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c707d54-4c6f-4fba-aa7c-fab5d314dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4711f9-9337-437b-ab50-59dd339b9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Volume d98fd572-de0f-456c-a4a9-69a759870d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98fd572-de0f-456c-a4a9-69a759870d82', 'volume_size': 1} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2efa6c02-6a1d-446d-87ea-fa82397ed3e0,created_at=2026-07-10T17:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716300864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efa6c02-6a1d-446d-87ea-fa82397ed3e0,host='devstack@QuobyteHD#QuobyteHD',id=d98fd572-de0f-456c-a4a9-69a759870d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:37:44Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f7de0c9-fa1f-4b62-9194-d0284d74208a),volume_type_id=1f7de0c9-fa1f-4b62-9194-d0284d74208a)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Creating volume d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:37:43 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:37:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:43 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 1073741824 Jul 10 19:37:43 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:44 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-019d4f24-49fa-4337-bdf6-fb844df75e26" returned: 0 in 0.864s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-019d4f24-49fa-4337-bdf6-fb844df75e26" released by "delete_volume" :: held 1.714s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Created reservations ['df111887-f20c-45be-ae81-37a4070d8cdc'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:44 devstack cinder-volume[87164]: WARNING cinder.quota [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1745635943 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1745635943, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:37:44 devstack cinder-volume[87164]: WARNING cinder.quota [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1745635943 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1745635943, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Created reservations ['18d8aef8-34e3-4941-b0b8-5a8b661ed6d4', '290efd20-557b-4dba-9a6e-d12c4d3055ee', '129c0e1d-17fb-4358-86e5-8ca999428771', '57e4e997-c741-4521-bf12-c3cbc34bb186'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:44 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:37:44 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:44 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 1073741824" returned: 0 in 0.914s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:44 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 Jul 10 19:37:44 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Acquiring lock "cinder-quobyte-582525f3-adf4-4da3-af53-6a827da14ab1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:37:45 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.763s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-582525f3-adf4-4da3-af53-6a827da14ab1" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:37:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ec1fcfb7-c85c-4f4d-b1fa-d09a7cf30e6c tempest-GroupsV314Test-717487271 None] Delete group completed successfully. Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebff0d4-5724-41e0-a00f-5b301113491b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:45 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:45 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:45 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4711f9-9337-437b-ab50-59dd339b9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98fd572-de0f-456c-a4a9-69a759870d82', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83183e-9116-4835-b91b-79d0fb8461ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:37:45 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Volume volume-d98fd572-de0f-456c-a4a9-69a759870d82 (d98fd572-de0f-456c-a4a9-69a759870d82): created successfully Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83183e-9116-4835-b91b-79d0fb8461ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:37:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (9439e550-8a24-48f0-b6d9-1e82a88682a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:37:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8a00fbb3-ec08-4979-a947-5d4e0d173e28 tempest-GroupSnapshotsTest-283473984 None] Created volume successfully. Jul 10 19:37:46 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 0.876s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:46 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1 Jul 10 19:37:46 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4f796525-78be-4e2d-a174-ee7752874aea tempest-GroupSnapshotsTest-283473984 None] Update group completed successfully. Jul 10 19:37:46 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-582525f3-adf4-4da3-af53-6a827da14ab1" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Lock "cinder-quobyte-582525f3-adf4-4da3-af53-6a827da14ab1" released by "delete_volume" :: held 1.656s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Created reservations ['70467aea-7ba0-4439-9d29-ab2c993ae680'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Created reservations ['d26493e9-0729-4aac-bb50-802b50604ed3', '5ab95125-c252-4664-afc3-8b2de9460b80', '9e071327-9edf-4202-943b-996bb59bae1f', 'd37b01ae-e023-4b21-8f53-a4c78bd2af72'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:47 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:37:47 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9f2b1972-b6d5-4c1f-a0e0-d21486beee0f tempest-GroupSnapshotsTest-283473984 None] Update group completed successfully. Jul 10 19:37:47 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.734s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:47 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:37:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-132fb29f-82e4-408d-a1e3-785f50e6a225 tempest-GroupsV314Test-717487271 None] Delete group completed successfully. Jul 10 19:37:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-244590fa-a137-4865-b446-a2f19a414cf8 tempest-GroupSnapshotsTest-283473984 None] Update group completed successfully. Jul 10 19:37:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cf6a5e4f-b3e6-465b-8a24-52e6327cca6e tempest-GroupSnapshotsTest-283473984 None] Update group completed successfully. Jul 10 19:37:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] GroupSnapshot 4a65adb7-98dd-4413-8c28-0a99e00d2f5d: creating. Jul 10 19:37:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Group snapshot 4a65adb7-98dd-4413-8c28-0a99e00d2f5d: creating. {{(pid=87164) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 19:37:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Creating offline snapshot 3cb3d99d-1392-4823-af1b-efae7938a524 of volume 255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:37:51 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[89686185-d8c4-4b2f-88ce-8e1408ff402d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:52 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 Jul 10 19:37:52 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-a99d6bde-f5f6-46d2-b616-d136c5f1d27f req-7ca71993-4cf6-411b-a08e-3830c00dc827 tempest-ServerActionsTestOtherA-1691401630 None] Terminate volume connection completed successfully. Jul 10 19:37:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-a99d6bde-f5f6-46d2-b616-d136c5f1d27f req-7ca71993-4cf6-411b-a08e-3830c00dc827 tempest-ServerActionsTestOtherA-1691401630 None] Deleting attachment 3be1274e-8a84-4ea8-9536-99bc5b1321b1. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:37:52 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438" returned: 0 in 0.840s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:52 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 1G Jul 10 19:37:52 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:53 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 1G" returned: 0 in 0.853s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:53 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 Jul 10 19:37:53 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:54 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524" returned: 0 in 0.762s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:54 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:54 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 Jul 10 19:37:54 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:55 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524" returned: 0 in 0.747s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:55 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info Jul 10 19:37:55 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:55 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info" returned: 0 in 0.764s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:55 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:55 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info Jul 10 19:37:55 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:56 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.info" returned: 0 in 0.921s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Creating offline snapshot 94b8159c-141b-4753-a7b1-48018b64d1d1 of volume d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab071473-bf3b-42ce-8320-5da4d02a1b05]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:37:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:57 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 Jul 10 19:37:57 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:57 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82" returned: 0 in 0.878s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:57 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 1G Jul 10 19:37:57 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:58 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 1G" returned: 0 in 0.956s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98fd572-de0f-456c-a4a9-69a759870d82 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:58 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98fd572-de0f-456c-a4a9-69a759870d82 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 Jul 10 19:37:58 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:37:59 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Jul 10 19:37:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98fd572-de0f-456c-a4a9-69a759870d82 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1" returned: 0 in 0.717s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:37:59 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:37:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:37:59 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 Jul 10 19:37:59 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:00 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1" returned: 0 in 0.649s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:00 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info Jul 10 19:38:00 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:00 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:00 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:38:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:00 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info Jul 10 19:38:00 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:01 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.info" returned: 0 in 0.632s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.617s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.868s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2f68e-22ef-4489-8e47-6a0ad0b992fd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dfc502c2-d1ad-4f8e-b459-622b9d2d0af4 tempest-GroupSnapshotsTest-283473984 None] group_snapshot 4a65adb7-98dd-4413-8c28-0a99e00d2f5d: created successfully Jul 10 19:38:01 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 Jul 10 19:38:01 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:02 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0" returned: 0 in 0.859s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-88aae575-adac-47d8-81e3-3034cb1a35a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d11258f-785e-4637-9c9b-5c618d2b2b87', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:38:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-122399ed-1000-4f12-871b-bb7a075bf82b req-89ee319a-1732-48a8-a1f8-2bc92dba8414 tempest-TaggedAttachmentsTest-1248966858 None] attachment_update completed successfully. Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "cinder-04ffed2f-2dbd-478b-930f-d66dec4d7cc4-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Lock "cinder-04ffed2f-2dbd-478b-930f-d66dec4d7cc4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "cinder-quobyte-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Lock "cinder-quobyte-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70374a0-e6a3-46e7-8c80-614458dfe55e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:02 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 Jul 10 19:38:02 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] group_snapshot 4a65adb7-98dd-4413-8c28-0a99e00d2f5d: deleting Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] group_snapshot 4a65adb7-98dd-4413-8c28-0a99e00d2f5d: deleting {{(pid=87164) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-255a5677-e84a-4a7b-a724-c0bcbf8b3438" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-255a5677-e84a-4a7b-a724-c0bcbf8b3438" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-3cb3d99d-1392-4823-af1b-efae7938a524" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-3cb3d99d-1392-4823-af1b-efae7938a524" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Deleting offline snapshot 3cb3d99d-1392-4823-af1b-efae7938a524 of volume 255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:38:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] snapshot_file for this snap is: volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20958ae-793c-437f-a5a2-507b554d27ff]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:03 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 Jul 10 19:38:03 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:03 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" returned: 0 in 0.834s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:03 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4 Jul 10 19:38:03 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:03 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524" returned: 0 in 0.855s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0a732-55f7-490c-8a99-28c6b7a0c295]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:04 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 Jul 10 19:38:04 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:04 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" returned: 0 in 0.738s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Lock "cinder-quobyte-04ffed2f-2dbd-478b-930f-d66dec4d7cc4" released by "delete_volume" :: held 1.631s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Created reservations ['8e62ba4f-f460-4caa-b544-1054ab6c64fb', '96bdeede-b9a2-487b-8c15-b256d5c3f2c2', 'f438b535-0e2a-43a6-9ef3-8fcfbd556b61', 'edf6ea84-d91a-4ef7-b7c5-72bf74ad39f2'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:04 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:04 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:04 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438" returned: 0 in 0.819s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:04 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 Jul 10 19:38:04 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:05 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:05 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Deleted volume successfully. Jul 10 19:38:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2eb7dbe2-d526-40aa-8680-0fc7df37243c tempest-ServerActionsTestOtherA-1691401630 None] Lock "cinder-04ffed2f-2dbd-478b-930f-d66dec4d7cc4-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:05 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524" returned: 0 in 0.918s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:05 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524 Jul 10 19:38:05 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:06 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438.3cb3d99d-1392-4823-af1b-efae7938a524" returned: 0 in 0.764s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-3cb3d99d-1392-4823-af1b-efae7938a524" released by "_delete_snapshot" :: held 3.468s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-255a5677-e84a-4a7b-a724-c0bcbf8b3438" released by "delete_snapshot" :: held 3.492s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-d98fd572-de0f-456c-a4a9-69a759870d82" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-d98fd572-de0f-456c-a4a9-69a759870d82" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-94b8159c-141b-4753-a7b1-48018b64d1d1" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-94b8159c-141b-4753-a7b1-48018b64d1d1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Deleting offline snapshot 94b8159c-141b-4753-a7b1-48018b64d1d1 of volume d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] snapshot_file for this snap is: volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df5cdcb-6923-476a-a9aa-5041fd446d5e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:06 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 Jul 10 19:38:06 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:07 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1" returned: 0 in 1.085s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d98fd572-de0f-456c-a4a9-69a759870d82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:38:07 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf61354-299b-40a3-a955-52c697234324]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:07 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 Jul 10 19:38:07 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:08 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82" returned: 0 in 0.924s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:08 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 Jul 10 19:38:08 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-9f79da5b-ae9d-4268-af31-4358e8108352 req-868dbf86-eecb-422a-bbee-f686b3cd0208 tempest-TaggedAttachmentsTest-1248966858 None] Terminate volume connection completed successfully. Jul 10 19:38:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-9f79da5b-ae9d-4268-af31-4358e8108352 req-868dbf86-eecb-422a-bbee-f686b3cd0208 tempest-TaggedAttachmentsTest-1248966858 None] Deleting attachment 1d11258f-785e-4637-9c9b-5c618d2b2b87. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:38:09 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1" returned: 0 in 0.923s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:09 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1 Jul 10 19:38:09 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:10 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82.94b8159c-141b-4753-a7b1-48018b64d1d1" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-94b8159c-141b-4753-a7b1-48018b64d1d1" released by "_delete_snapshot" :: held 3.774s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-d98fd572-de0f-456c-a4a9-69a759870d82" released by "delete_snapshot" :: held 3.818s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:10 devstack cinder-volume[87164]: WARNING cinder.quota [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-550983722 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-550983722, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:38:10 devstack cinder-volume[87164]: WARNING cinder.quota [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-550983722 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-550983722, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:38:10 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['7f482292-70ee-441f-94f7-947d3e8f82f6', '608e22a5-c127-4b42-b9c3-0c6f55f93348', '245377c4-2a79-420b-80da-66b7ae2f227d', '0ab6f220-c069-4e25-a710-b055a68f7f9a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:10 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['3fea7882-4c34-467d-b0ce-6830fc66694d', 'd73fb172-1f42-4c76-85d9-2c601cebee9e', '5125c943-db79-4fb3-9663-18271c052fbe', 'dd650ab9-04bf-4e7a-bfca-23987743772c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a02bd263-7d44-43c8-b6c5-a5951de0d991 tempest-GroupSnapshotsTest-283473984 None] group_snapshot 4a65adb7-98dd-4413-8c28-0a99e00d2f5d: deleted successfully Jul 10 19:38:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-255a5677-e84a-4a7b-a724-c0bcbf8b3438" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-255a5677-e84a-4a7b-a724-c0bcbf8b3438" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa5d51-c790-477d-b857-7cdafa9f458c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:11 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 Jul 10 19:38:11 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:12 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438" returned: 0 in 1.073s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:12 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438 Jul 10 19:38:12 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:13 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-255a5677-e84a-4a7b-a724-c0bcbf8b3438" returned: 0 in 0.847s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-255a5677-e84a-4a7b-a724-c0bcbf8b3438" released by "delete_volume" :: held 2.003s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-d98fd572-de0f-456c-a4a9-69a759870d82" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-d98fd572-de0f-456c-a4a9-69a759870d82" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:13 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[df01477c-de76-4805-882c-e1071b2d0a1e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:13 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 Jul 10 19:38:13 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:14 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82" returned: 0 in 0.990s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:14 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82 Jul 10 19:38:14 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:14 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d98fd572-de0f-456c-a4a9-69a759870d82" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-d98fd572-de0f-456c-a4a9-69a759870d82" released by "delete_volume" :: held 1.805s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['71bc0de2-d1da-455e-8aa6-498f39adebbd'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:15 devstack cinder-volume[87164]: WARNING cinder.quota [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-550983722 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-550983722, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['89432d4e-ad84-47ae-aeb0-caedd8d56a0d', 'a8575242-3acc-4d8b-b744-700a54cac75f', '5e38ed83-21fd-4443-9e73-8bb358c44ee9', '4ae50d3e-3352-4721-8c5f-570e3e4a309e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['547ad05b-b6c4-4957-b52d-16ea9c3f328b', '503ba604-247c-4154-a584-92bf320dc615', '09041bf5-27fd-44a2-bb0e-008636ea298e', 'b60792f6-5248-459f-9229-41dc484a688f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:15 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:15 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:16 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.804s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:16 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a6a91675-7434-461f-aaf6-3eb5147f6843 tempest-GroupSnapshotsTest-283473984 None] Delete group completed successfully. Jul 10 19:38:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6a64e461-ab2b-4843-a073-080263e8ada0 tempest-GroupSnapshotsTest-283473984 None] Group tempest-GroupSnapshotsTest-Group-1883740888: creating Jul 10 19:38:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6a64e461-ab2b-4843-a073-080263e8ada0 tempest-GroupSnapshotsTest-283473984 None] Group tempest-GroupSnapshotsTest-Group-1883740888: created successfully Jul 10 19:38:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6a64e461-ab2b-4843-a073-080263e8ada0 tempest-GroupSnapshotsTest-283473984 None] Create group completed successfully. Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (425a6c14-3901-4400-a92b-cebe27aa7562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca77545f-d85c-44dd-9778-894c528bdfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca77545f-d85c-44dd-9778-894c528bdfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529994098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1a2abc8-bfdd-426f-9274-2a5000528448,host='devstack@QuobyteHD#QuobyteHD',id=fdf672c3-f56f-4396-9cac-83cd075fa1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:38:18Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(846f43c3-71fb-4407-bf9e-6a806814d5d6),volume_type_id=846f43c3-71fb-4407-bf9e-6a806814d5d6)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ace5e52-a076-4129-8751-3dc397286109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ace5e52-a076-4129-8751-3dc397286109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccab2b9-3679-4885-a29c-69709b62d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccab2b9-3679-4885-a29c-69709b62d604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf672c3-f56f-4396-9cac-83cd075fa1be', 'volume_name': 'volume-fdf672c3-f56f-4396-9cac-83cd075fa1be', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b129e456-166d-4359-a74a-5c702a7eecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b129e456-166d-4359-a74a-5c702a7eecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27f396e-c523-4541-8a11-213d30a0382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:18 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Volume fdf672c3-f56f-4396-9cac-83cd075fa1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf672c3-f56f-4396-9cac-83cd075fa1be', 'volume_size': 1} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1a2abc8-bfdd-426f-9274-2a5000528448,created_at=2026-07-10T17:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529994098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1a2abc8-bfdd-426f-9274-2a5000528448,host='devstack@QuobyteHD#QuobyteHD',id=fdf672c3-f56f-4396-9cac-83cd075fa1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ece6e74fe241ccbcd0670f8753f37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:38:18Z,use_quota=True,user_id='c229b4ea66094f8ebc8adcb6751b4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(846f43c3-71fb-4407-bf9e-6a806814d5d6),volume_type_id=846f43c3-71fb-4407-bf9e-6a806814d5d6)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Creating volume fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:38:18 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:38:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:18 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be 1073741824 Jul 10 19:38:18 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:19 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be 1073741824" returned: 0 in 1.323s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:20 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be Jul 10 19:38:20 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:20 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be" returned: 0 in 0.780s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27f396e-c523-4541-8a11-213d30a0382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf672c3-f56f-4396-9cac-83cd075fa1be', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2920651-5f9a-452e-b04b-5f2457c07083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Volume volume-fdf672c3-f56f-4396-9cac-83cd075fa1be (fdf672c3-f56f-4396-9cac-83cd075fa1be): created successfully Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2920651-5f9a-452e-b04b-5f2457c07083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Flow 'volume_create_manager' (425a6c14-3901-4400-a92b-cebe27aa7562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:38:20 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-128d830b-c62c-47f6-99bf-02d9c142d5e0 tempest-GroupSnapshotsTest-283473984 None] Created volume successfully. Jul 10 19:38:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] GroupSnapshot ac53aac8-c9dc-47a0-9284-a9996c88113b: creating. Jul 10 19:38:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Group snapshot ac53aac8-c9dc-47a0-9284-a9996c88113b: creating. {{(pid=87164) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 19:38:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Creating offline snapshot 103b95a9-b283-4ce3-a113-1bc8234c9d33 of volume fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:38:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ec0464-5b82-40ea-b29a-9a221ab6a84a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:22 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be Jul 10 19:38:22 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Flow 'volume_create_manager' (40223dc7-bea2-4020-aeb1-8f0cf8d74bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb035b9-07c6-4945-9185-4fd9a4f3a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb035b9-07c6-4945-9185-4fd9a4f3a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1188476873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974d5381-24e0-454b-bd05-b31ee5914688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda5ca20535d48039bf2743b942795d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:38:23Z,use_quota=True,user_id='267bfa4665424892bf17f70b50f6540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ac0b08-139c-4da0-853f-3d0310a93634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ac0b08-139c-4da0-853f-3d0310a93634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1302fbc2-7b8f-48e5-9db5-723cf5760019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1302fbc2-7b8f-48e5-9db5-723cf5760019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974d5381-24e0-454b-bd05-b31ee5914688', 'volume_name': 'volume-974d5381-24e0-454b-bd05-b31ee5914688', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1721a5c3-f442-4805-8606-b45cadc6726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1721a5c3-f442-4805-8606-b45cadc6726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e7bb3a-e9f7-4f45-9e26-e0bfe97772d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Volume 974d5381-24e0-454b-bd05-b31ee5914688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974d5381-24e0-454b-bd05-b31ee5914688', 'volume_size': 1} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:23 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be" returned: 0 in 0.955s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:23 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 1G Jul 10 19:38:23 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:24 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 1G" returned: 0 in 0.864s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf672c3-f56f-4396-9cac-83cd075fa1be -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:24 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf672c3-f56f-4396-9cac-83cd075fa1be -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 Jul 10 19:38:24 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:25 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf672c3-f56f-4396-9cac-83cd075fa1be -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33" returned: 0 in 0.745s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:25 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:38:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:25 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 Jul 10 19:38:25 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:25 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33" returned: 0 in 0.703s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:25 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info Jul 10 19:38:25 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:26 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info" returned: 0 in 0.717s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:26 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:26 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info Jul 10 19:38:26 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Acquiring lock "cinder-88aae575-adac-47d8-81e3-3034cb1a35a0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Lock "cinder-88aae575-adac-47d8-81e3-3034cb1a35a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Acquiring lock "cinder-quobyte-88aae575-adac-47d8-81e3-3034cb1a35a0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Lock "cinder-quobyte-88aae575-adac-47d8-81e3-3034cb1a35a0" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bca472b-f2e7-4433-94f2-ae1fb6f03102]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:27 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 Jul 10 19:38:27 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:27 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.info" returned: 0 in 0.772s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.876s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.102s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1188476873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974d5381-24e0-454b-bd05-b31ee5914688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda5ca20535d48039bf2743b942795d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:38:23Z,use_quota=True,user_id='267bfa4665424892bf17f70b50f6540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Creating volume 974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:38:27 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:27 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 1073741824 Jul 10 19:38:27 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1ce043f8-043c-4edf-9ad4-91722ab2f821 tempest-GroupSnapshotsTest-283473984 None] group_snapshot ac53aac8-c9dc-47a0-9284-a9996c88113b: created successfully Jul 10 19:38:27 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0" returned: 0 in 0.989s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:27 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0 Jul 10 19:38:27 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] group_snapshot ac53aac8-c9dc-47a0-9284-a9996c88113b: deleting Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] group_snapshot ac53aac8-c9dc-47a0-9284-a9996c88113b: deleting {{(pid=87164) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-fdf672c3-f56f-4396-9cac-83cd075fa1be" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-fdf672c3-f56f-4396-9cac-83cd075fa1be" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-103b95a9-b283-4ce3-a113-1bc8234c9d33" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-103b95a9-b283-4ce3-a113-1bc8234c9d33" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Deleting offline snapshot 103b95a9-b283-4ce3-a113-1bc8234c9d33 of volume fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] snapshot_file for this snap is: volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae224fc4-45ee-4e7a-a21a-a0db79f5c5de]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:28 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 Jul 10 19:38:28 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:28 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 1073741824" returned: 0 in 1.274s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:28 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 Jul 10 19:38:28 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:28 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-88aae575-adac-47d8-81e3-3034cb1a35a0" returned: 0 in 1.081s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Lock "cinder-quobyte-88aae575-adac-47d8-81e3-3034cb1a35a0" released by "delete_volume" :: held 2.144s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Created reservations ['a9127ac3-43d4-4aac-9222-93a528c86571', '7f603098-f697-4d3d-bba1-3b0965326123', '9be4ce7e-6fed-4577-b6bf-4d9fca95439c', '44ed8cb1-49d1-4c71-a0ff-e63de333bbf5'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:29 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:29 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:29 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33" returned: 0 in 1.259s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf672c3-f56f-4396-9cac-83cd075fa1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8802751-c439-4149-aa6b-4647e3889213]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:29 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688" returned: 0 in 1.003s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e7bb3a-e9f7-4f45-9e26-e0bfe97772d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974d5381-24e0-454b-bd05-b31ee5914688', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f26dd53-8731-4737-9846-6fb7bf58ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:38:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Volume volume-974d5381-24e0-454b-bd05-b31ee5914688 (974d5381-24e0-454b-bd05-b31ee5914688): created successfully Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f26dd53-8731-4737-9846-6fb7bf58ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:38:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Flow 'volume_create_manager' (40223dc7-bea2-4020-aeb1-8f0cf8d74bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:38:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-23b93850-6821-4a12-9b74-5e71b3a488e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Created volume successfully. Jul 10 19:38:29 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be Jul 10 19:38:29 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:30 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:30 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Deleted volume successfully. Jul 10 19:38:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-42140d8a-ac7c-4c80-9a02-a94d1eded566 tempest-TaggedAttachmentsTest-1248966858 None] Lock "cinder-88aae575-adac-47d8-81e3-3034cb1a35a0-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:30 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be" returned: 0 in 1.147s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:30 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 Jul 10 19:38:30 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Creating offline snapshot 5b40ea92-99d6-4fb8-9131-da255987c448 of volume 974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa54e05-315f-4180-8f5e-5a65745f890e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:31 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 Jul 10 19:38:31 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:31 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33" returned: 0 in 1.132s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:31 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33 Jul 10 19:38:31 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:32 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688" returned: 0 in 1.014s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:32 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 1G Jul 10 19:38:32 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:32 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be.103b95a9-b283-4ce3-a113-1bc8234c9d33" returned: 0 in 0.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-103b95a9-b283-4ce3-a113-1bc8234c9d33" released by "_delete_snapshot" :: held 4.606s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-fdf672c3-f56f-4396-9cac-83cd075fa1be" released by "delete_snapshot" :: held 4.643s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:32 devstack cinder-volume[87164]: WARNING cinder.quota [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-195024566 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-195024566, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:38:32 devstack cinder-volume[87164]: WARNING cinder.quota [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-195024566 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-195024566, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:38:33 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['4f5eab07-5b5c-4c8d-984b-2ee26bfa300f', '3f9bb18a-29bc-4026-9c04-35135c8e87bb', 'cebcade4-da6c-44e3-b5ba-df1951ff275c', '2913a1b5-0aa3-492d-b08b-9c55435db3ca'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-812407fa-6fa7-486e-9429-8bb4e0ba33c1 tempest-GroupSnapshotsTest-283473984 None] group_snapshot ac53aac8-c9dc-47a0-9284-a9996c88113b: deleted successfully Jul 10 19:38:33 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 1G" returned: 0 in 1.066s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974d5381-24e0-454b-bd05-b31ee5914688 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:33 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974d5381-24e0-454b-bd05-b31ee5914688 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 Jul 10 19:38:33 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:34 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974d5381-24e0-454b-bd05-b31ee5914688 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448" returned: 0 in 0.905s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:34 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 is being set with open permissions: ugo+rw Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:34 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 Jul 10 19:38:34 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "cinder-quobyte-fdf672c3-f56f-4396-9cac-83cd075fa1be" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-fdf672c3-f56f-4396-9cac-83cd075fa1be" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d8bdc-9c1c-4759-90cc-70af6f6b11b2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:34 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be Jul 10 19:38:34 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:34 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448" returned: 0 in 0.905s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:35 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info Jul 10 19:38:35 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:35 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be" returned: 0 in 1.270s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:35 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be Jul 10 19:38:35 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:36 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info" returned: 0 in 0.958s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:36 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info is being set with open permissions: ugo+rw Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:36 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info Jul 10 19:38:36 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:36 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-fdf672c3-f56f-4396-9cac-83cd075fa1be" returned: 0 in 0.732s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Lock "cinder-quobyte-fdf672c3-f56f-4396-9cac-83cd075fa1be" released by "delete_volume" :: held 2.121s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['d8a398dc-3a4f-4a96-9764-1774777b9435'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:36 devstack cinder-volume[87164]: WARNING cinder.quota [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-195024566 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-195024566, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Created reservations ['ed187824-c579-46e1-9fea-9f08730513cb', '4514391c-f304-4eea-bc32-ad89d75b7171', 'a8f1104b-a936-4ed7-80df-879bcddd5235', '31f62f0a-fdd3-4934-8a6e-41dcdd327765'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:36 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.info" returned: 0 in 0.785s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.807s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a402604a-e37a-4371-a22a-a04db3ba6f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Create snapshot completed successfully Jul 10 19:38:36 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:36 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:37 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:37 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:37 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.839s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:37 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3146a9f5-5d13-47f4-bea6-0cc2e92fc883 tempest-GroupSnapshotsTest-283473984 None] Delete group completed successfully. Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "cinder-5b40ea92-99d6-4fb8-9131-da255987c448-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-5b40ea92-99d6-4fb8-9131-da255987c448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "cinder-quobyte-974d5381-24e0-454b-bd05-b31ee5914688" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-quobyte-974d5381-24e0-454b-bd05-b31ee5914688" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "cinder-quobyte-5b40ea92-99d6-4fb8-9131-da255987c448" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-quobyte-5b40ea92-99d6-4fb8-9131-da255987c448" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Deleting offline snapshot 5b40ea92-99d6-4fb8-9131-da255987c448 of volume 974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] snapshot_file for this snap is: volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[14735dbe-a829-4568-b54e-3bec2b7264e1]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:38 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 Jul 10 19:38:38 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:38 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.891s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 8 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:38:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:38:39 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448" returned: 0 in 0.966s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974d5381-24e0-454b-bd05-b31ee5914688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:38:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b147179-19c8-40c5-b06e-d655aac04fa3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:39 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 Jul 10 19:38:39 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:40 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688" returned: 0 in 0.975s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:40 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 Jul 10 19:38:40 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:41 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448" returned: 0 in 1.041s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:41 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448 Jul 10 19:38:41 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:42 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688.5b40ea92-99d6-4fb8-9131-da255987c448" returned: 0 in 0.952s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=117,cinder:SELECT=108,cinder:DELETE=5,cinder:INSERT=22 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=109,cinder:SELECT=114,cinder:INSERT=30,cinder:DELETE=2 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-quobyte-5b40ea92-99d6-4fb8-9131-da255987c448" released by "_delete_snapshot" :: held 4.144s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-quobyte-974d5381-24e0-454b-bd05-b31ee5914688" released by "delete_snapshot" :: held 4.185s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Created reservations ['5f6b7873-0b27-4abf-a8f9-0a8dd0e33819', 'b31d3e9b-e198-4e32-8497-420598c1e526', 'e8817bd0-af94-43b7-a20d-8663343c13e9', 'ba410a7b-5499-4f1c-a3d0-a4faacfd838c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Delete snapshot completed successfully. Jul 10 19:38:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8e53ae6a-20e3-4d74-9a59-11cdf8db2baf tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-5b40ea92-99d6-4fb8-9131-da255987c448-delete_snapshot" released by "delete_snapshot" :: held 4.397s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "cinder-974d5381-24e0-454b-bd05-b31ee5914688-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-974d5381-24e0-454b-bd05-b31ee5914688-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "cinder-quobyte-974d5381-24e0-454b-bd05-b31ee5914688" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:38:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-quobyte-974d5381-24e0-454b-bd05-b31ee5914688" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:38:43 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cabd1c0-02db-455d-a4f0-c8986acd6fd2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:38:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:44 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 Jul 10 19:38:44 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:44 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688" returned: 0 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:44 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688 Jul 10 19:38:44 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3f82a178-669e-4660-a8ea-6c42ad610278 tempest-GroupsV320Test-2096755465 None] Group tempest-GroupsV320Test-Group-2089943756: creating Jul 10 19:38:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3f82a178-669e-4660-a8ea-6c42ad610278 tempest-GroupsV320Test-2096755465 None] Group tempest-GroupsV320Test-Group-2089943756: created successfully Jul 10 19:38:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3f82a178-669e-4660-a8ea-6c42ad610278 tempest-GroupsV320Test-2096755465 None] Create group completed successfully. Jul 10 19:38:45 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-974d5381-24e0-454b-bd05-b31ee5914688" returned: 0 in 0.829s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-quobyte-974d5381-24e0-454b-bd05-b31ee5914688" released by "delete_volume" :: held 1.885s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Created reservations ['da0f8c56-9351-4e15-899b-11c4fc0276dd', 'caff0f8e-ebea-45f2-b01e-4b8610d98ddd', '22befc91-c99a-41f4-ae48-4a5c5af4a9b1', '23f8f9ea-544f-42e5-8134-b5d625f80c43'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:45 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:45 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:47 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.372s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Deleted volume successfully. Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb7a4a92-9660-4b63-ae59-705b0ce1a7fc tempest-VolumeSnapshotQuotasNegativeTestJSON-39089988 None] Lock "cinder-974d5381-24e0-454b-bd05-b31ee5914688-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Created reservations ['3dd01e4d-3979-453a-90ea-a01b347767b8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:38:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:38:47 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:38:47 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:38:48 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jul 10 19:38:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.873s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:38:48 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:38:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-423dfb04-622a-42c8-9be6-211fc4762aa1 tempest-GroupsV320Test-2096755465 None] Delete group completed successfully. Jul 10 19:38:57 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:38:57 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (2f6d5b3a-9056-4608-8159-fee9efe10fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e034ac2-48a2-48e8-8c3c-a8922c6c9f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e034ac2-48a2-48e8-8c3c-a8922c6c9f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-288325933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ebbb7d-24b3-4ad1-8afd-9afe66d9d702,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:14Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a7ca8f-570a-4246-8781-81e3b00a2ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a7ca8f-570a-4246-8781-81e3b00a2ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98199895-0110-4297-aec4-9168bc646f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98199895-0110-4297-aec4-9168bc646f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ebbb7d-24b3-4ad1-8afd-9afe66d9d702', 'volume_name': 'volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c36f3d-5aab-445b-a9f8-c63c897b3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c36f3d-5aab-445b-a9f8-c63c897b3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dbdc1c-57db-43f0-b247-7c0b1a449d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Volume 25ebbb7d-24b3-4ad1-8afd-9afe66d9d702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702', 'volume_size': 1} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-288325933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ebbb7d-24b3-4ad1-8afd-9afe66d9d702,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:14Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Creating volume 25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:39:14 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:39:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:14 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 1073741824 Jul 10 19:39:14 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:16 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 1073741824" returned: 0 in 1.785s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:16 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 Jul 10 19:39:16 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Flow 'volume_create_manager' (28c6b842-7942-471e-a865-c48c0b339eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ef5437-fa73-4b61-b345-033628d1ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ef5437-fa73-4b61-b345-033628d1ad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1822308709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6bf4e4-8c63-4e5e-bd85-431235bad166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2848f7fc74534515a4a23181e9d92d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:17Z,use_quota=True,user_id='80eb001ae4d64c5f9ff6bff1c1b7fbdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57df90f-55bc-42aa-aadd-dbc6375a7052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57df90f-55bc-42aa-aadd-dbc6375a7052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c103a4e-d26b-4fee-a613-6f9c20294f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c103a4e-d26b-4fee-a613-6f9c20294f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6bf4e4-8c63-4e5e-bd85-431235bad166', 'volume_name': 'volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6667582-1e08-4e01-85d7-977f6bf88ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6667582-1e08-4e01-85d7-977f6bf88ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69941529-a649-4df6-8ad8-8c9ffd650efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:16 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Volume 4a6bf4e4-8c63-4e5e-bd85-431235bad166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166', 'volume_size': 1} Jul 10 19:39:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:17 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702" returned: 0 in 1.271s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] <== create_volume: return (3179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.185s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1822308709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6bf4e4-8c63-4e5e-bd85-431235bad166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2848f7fc74534515a4a23181e9d92d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:17Z,use_quota=True,user_id='80eb001ae4d64c5f9ff6bff1c1b7fbdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Creating volume 4a6bf4e4-8c63-4e5e-bd85-431235bad166 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:39:17 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dbdc1c-57db-43f0-b247-7c0b1a449d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:17 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 1073741824 Jul 10 19:39:17 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02b9117-fd59-4511-8c73-0e0b5b5b4f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:17 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Volume volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 (25ebbb7d-24b3-4ad1-8afd-9afe66d9d702): created successfully Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02b9117-fd59-4511-8c73-0e0b5b5b4f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (2f6d5b3a-9056-4608-8159-fee9efe10fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c72318d9-8e62-4b6d-8289-3ef615edb0d2 tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:39:18 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 1073741824" returned: 0 in 1.164s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:18 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 Jul 10 19:39:18 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:19 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:19 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (11bf7680-db9e-41ef-9dde-c4e47dad00ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07fce3a-d9bf-46b1-9079-a343c2b7dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166" returned: 0 in 1.162s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07fce3a-d9bf-46b1-9079-a343c2b7dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1221665636',display_name='tempest-VolumesGetTest-Volume-1597457928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33765caa-2778-48bd-9d9a-4b6525b7a8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:20Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc945d6-9bb8-4150-a0b0-9fd3169ac7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc945d6-9bb8-4150-a0b0-9fd3169ac7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a88d84-bcae-41bd-9e6d-8fe842c32cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a88d84-bcae-41bd-9e6d-8fe842c32cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33765caa-2778-48bd-9d9a-4b6525b7a8f0', 'volume_name': 'volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107edec4-fa31-4ad6-9075-5c890d280410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107edec4-fa31-4ad6-9075-5c890d280410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dec4eb4-559d-423c-88d0-a9260b6e7353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Volume 33765caa-2778-48bd-9d9a-4b6525b7a8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0', 'volume_size': 1} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1221665636',display_name='tempest-VolumesGetTest-Volume-1597457928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33765caa-2778-48bd-9d9a-4b6525b7a8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:20Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Creating volume 33765caa-2778-48bd-9d9a-4b6525b7a8f0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:39:20 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69941529-a649-4df6-8ad8-8c9ffd650efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638b7763-23c7-4673-8465-e3c700be6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:20 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 1073741824 Jul 10 19:39:20 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Volume volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 (4a6bf4e4-8c63-4e5e-bd85-431235bad166): created successfully Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638b7763-23c7-4673-8465-e3c700be6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Flow 'volume_create_manager' (28c6b842-7942-471e-a865-c48c0b339eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:20 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a8df7622-49a9-4692-b2a9-b9aac3d6185d tempest-ServerRescueNegativeTestJSON-846666165 None] Created volume successfully. Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Flow 'volume_create_manager' (115d0765-d011-4853-85c5-40176b32b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45689039-64b4-4a02-be62-b27f3c727b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 1073741824" returned: 0 in 1.028s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:21 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45689039-64b4-4a02-be62-b27f3c727b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-946024898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26dfa2b-560e-490e-987a-81bccf4a0763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906f38b3276f4caf80466d6f2c366532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:21Z,use_quota=True,user_id='de465496d2c24b6db92bd37bdbf020e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d471c0-5c7a-47c2-b745-7f0fcbece6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d471c0-5c7a-47c2-b745-7f0fcbece6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d6afa0-0674-4ca3-b719-bb52d7901677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d6afa0-0674-4ca3-b719-bb52d7901677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26dfa2b-560e-490e-987a-81bccf4a0763', 'volume_name': 'volume-c26dfa2b-560e-490e-987a-81bccf4a0763', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831247e0-35e0-4722-924e-f90e823ea3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831247e0-35e0-4722-924e-f90e823ea3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cbdc4e-9809-4a3b-87b0-9d48d3c5e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Volume c26dfa2b-560e-490e-987a-81bccf4a0763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26dfa2b-560e-490e-987a-81bccf4a0763', 'volume_size': 1} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:21 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 Jul 10 19:39:21 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:22 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0" returned: 0 in 1.276s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-946024898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26dfa2b-560e-490e-987a-81bccf4a0763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906f38b3276f4caf80466d6f2c366532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:21Z,use_quota=True,user_id='de465496d2c24b6db92bd37bdbf020e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Creating volume c26dfa2b-560e-490e-987a-81bccf4a0763 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:39:22 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dec4eb4-559d-423c-88d0-a9260b6e7353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:22 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 1073741824 Jul 10 19:39:22 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c506afc-7463-40ce-a4ef-a19fba65f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Volume volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 (33765caa-2778-48bd-9d9a-4b6525b7a8f0): created successfully Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c506afc-7463-40ce-a4ef-a19fba65f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (11bf7680-db9e-41ef-9dde-c4e47dad00ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a3ade0d1-f4a4-4b81-9141-1607bc41b0a2 tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-33765caa-2778-48bd-9d9a-4b6525b7a8f0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Lock "cinder-33765caa-2778-48bd-9d9a-4b6525b7a8f0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-33765caa-2778-48bd-9d9a-4b6525b7a8f0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-33765caa-2778-48bd-9d9a-4b6525b7a8f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e09dccd-7161-48a3-90f5-769f7f54cfd5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:23 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 1073741824" returned: 0 in 1.222s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:23 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 Jul 10 19:39:23 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:23 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 Jul 10 19:39:23 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:25 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0" returned: 0 in 1.260s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:25 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0 Jul 10 19:39:25 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:25 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763" returned: 0 in 1.314s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] <== create_volume: return (2599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.610s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cbdc4e-9809-4a3b-87b0-9d48d3c5e597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26dfa2b-560e-490e-987a-81bccf4a0763', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcfb45b-a580-4e66-998f-517e17cad125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Volume volume-c26dfa2b-560e-490e-987a-81bccf4a0763 (c26dfa2b-560e-490e-987a-81bccf4a0763): created successfully Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcfb45b-a580-4e66-998f-517e17cad125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Flow 'volume_create_manager' (115d0765-d011-4853-85c5-40176b32b569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3f8d6d69-7baa-4784-adee-03119f2b3ecd tempest-VolumeQuotasAdminTestJSON-300014984 None] Created volume successfully. Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "cinder-c26dfa2b-560e-490e-987a-81bccf4a0763-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "cinder-c26dfa2b-560e-490e-987a-81bccf4a0763-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "cinder-quobyte-c26dfa2b-560e-490e-987a-81bccf4a0763" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "cinder-quobyte-c26dfa2b-560e-490e-987a-81bccf4a0763" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c880f1-c1c8-468f-a62a-f6eaf0a23570]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:26 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-33765caa-2778-48bd-9d9a-4b6525b7a8f0" returned: 0 in 1.185s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-33765caa-2778-48bd-9d9a-4b6525b7a8f0" released by "delete_volume" :: held 2.535s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Created reservations ['3f8e59ef-0c65-47bb-81a4-b906ffc6c20f', '4713c489-24f7-4dfb-bff2-89da99947bd8', 'e4784691-73dd-4a59-a684-967d591db0a3', 'da0253cc-b1ae-4f56-8356-31f573d769d4'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:39:26 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 Jul 10 19:39:26 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:26 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:39:26 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Lock "cinder-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702" acquired by "delete_volume" :: waited 0.054s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d30ab6-b541-457f-a3f7-59a39bdb96d5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:27 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.189s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:39:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:39:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aaac77eb-e525-47dc-8174-68df6b7686e5 tempest-VolumesGetTest-1784068748 None] Lock "cinder-33765caa-2778-48bd-9d9a-4b6525b7a8f0-delete_volume" released by "delete_volume" :: held 4.154s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:27 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 Jul 10 19:39:27 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:28 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763" returned: 0 in 1.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:28 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763 Jul 10 19:39:28 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:29 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702" returned: 0 in 1.469s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:29 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702 Jul 10 19:39:29 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:29 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c26dfa2b-560e-490e-987a-81bccf4a0763" returned: 0 in 1.282s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "cinder-quobyte-c26dfa2b-560e-490e-987a-81bccf4a0763" released by "delete_volume" :: held 3.298s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Created reservations ['2d7f3dbc-72db-4551-9738-86d2d7fd869b', '4d5e5d6f-df83-46b7-ad85-81b048bd6211', '3e2ed564-8d2a-4442-8a93-c261bf7fdf05', 'd869244c-75a4-40f0-8b96-37a1a5863e8e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:29 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:39:29 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:30 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702" returned: 0 in 1.061s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702" released by "delete_volume" :: held 2.582s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Created reservations ['fb7e9a65-6fae-4fac-a585-827f73e06be9', 'b6886012-2348-4ea8-ab15-ce97c296e864', '200b2fcd-9704-4f66-af29-0d1558cb2714', 'ae4f4e55-a9f5-4d61-91a1-b582036043a1'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:30 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:39:30 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:30 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.865s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:39:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Deleted volume successfully. Jul 10 19:39:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5c9ca862-e55e-48a9-896d-1bccebaf3b29 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "cinder-c26dfa2b-560e-490e-987a-81bccf4a0763-delete_volume" released by "delete_volume" :: held 4.661s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:31 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.233s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:31 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:39:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:39:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d191a433-7acf-4dd1-9a5d-b46293e077a6 tempest-VolumesGetTest-1784068748 None] Lock "cinder-25ebbb7d-24b3-4ad1-8afd-9afe66d9d702-delete_volume" released by "delete_volume" :: held 4.151s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Flow 'volume_create_manager' (db869ffd-18d7-439c-924a-1fd92a9f58b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e8e696-2830-41aa-b49d-3863171af846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e8e696-2830-41aa-b49d-3863171af846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1390407556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091e2caf-bf5d-45ca-b01d-45d722857ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906f38b3276f4caf80466d6f2c366532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:32Z,use_quota=True,user_id='de465496d2c24b6db92bd37bdbf020e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576f2787-6cf3-4d11-8d18-f73f518076a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576f2787-6cf3-4d11-8d18-f73f518076a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c917688-a258-4ba0-9194-cf2667d8f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c917688-a258-4ba0-9194-cf2667d8f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091e2caf-bf5d-45ca-b01d-45d722857ffa', 'volume_name': 'volume-091e2caf-bf5d-45ca-b01d-45d722857ffa', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889b2063-b47c-4972-b425-c03331d40f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889b2063-b47c-4972-b425-c03331d40f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b65bfb-3ad0-4742-b441-6a4dcf04aed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Volume 091e2caf-bf5d-45ca-b01d-45d722857ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091e2caf-bf5d-45ca-b01d-45d722857ffa', 'volume_size': 1} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1390407556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091e2caf-bf5d-45ca-b01d-45d722857ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906f38b3276f4caf80466d6f2c366532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:32Z,use_quota=True,user_id='de465496d2c24b6db92bd37bdbf020e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Creating volume 091e2caf-bf5d-45ca-b01d-45d722857ffa {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:39:32 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:32 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa 1073741824 Jul 10 19:39:32 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (a2efb62d-e8cf-48c8-bd95-2f3d84e77689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054ab2d7-9a70-4d15-b60e-bdd0b1441394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054ab2d7-9a70-4d15-b60e-bdd0b1441394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1715548368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3552a9-2658-4c1a-b05d-4954ea238e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:32Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5c3e16-804e-4fe4-aa47-76b7dc741c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5c3e16-804e-4fe4-aa47-76b7dc741c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919a5e01-54a0-4e1e-bd87-00b3fa113596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919a5e01-54a0-4e1e-bd87-00b3fa113596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'volume_name': 'volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04b6833-d005-467d-bebe-be74bb05e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04b6833-d005-467d-bebe-be74bb05e1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f7855b-89d5-422c-ac36-9e432dc18f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Volume 3e3552a9-2658-4c1a-b05d-4954ea238e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'volume_size': 1} Jul 10 19:39:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:33 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa 1073741824" returned: 0 in 1.229s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:33 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa Jul 10 19:39:33 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:34 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa" returned: 0 in 1.077s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.226s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1715548368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3552a9-2658-4c1a-b05d-4954ea238e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:32Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Creating volume 3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:39:34 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b65bfb-3ad0-4742-b441-6a4dcf04aed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091e2caf-bf5d-45ca-b01d-45d722857ffa', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:34 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c 1073741824 Jul 10 19:39:34 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89cc78e-523e-4b4d-9e0a-e10de1ffb757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:34 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Volume volume-091e2caf-bf5d-45ca-b01d-45d722857ffa (091e2caf-bf5d-45ca-b01d-45d722857ffa): created successfully Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89cc78e-523e-4b4d-9e0a-e10de1ffb757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Flow 'volume_create_manager' (db869ffd-18d7-439c-924a-1fd92a9f58b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1b2fe9fd-8999-46a7-aab2-7272c9a0f154 tempest-VolumeQuotasAdminTestJSON-300014984 None] Created volume successfully. Jul 10 19:39:36 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c 1073741824" returned: 0 in 1.554s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:36 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:39:36 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a3536a4d-2ed2-4111-97ea-189c700a6fdc tempest-VolumeQuotasAdminTestJSON-1587173432 None] Transfer volume completed successfully. Jul 10 19:39:37 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 0.841s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.480s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f7855b-89d5-422c-ac36-9e432dc18f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea98e9eb-bbcf-411d-9dd3-e62d5b004ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:37 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Volume volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c (3e3552a9-2658-4c1a-b05d-4954ea238e8c): created successfully Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea98e9eb-bbcf-411d-9dd3-e62d5b004ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (a2efb62d-e8cf-48c8-bd95-2f3d84e77689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0f84d330-375d-470c-aba5-5475a5dd96fb tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:37 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:39:37 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Acquiring lock "cinder-091e2caf-bf5d-45ca-b01d-45d722857ffa-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Lock "cinder-091e2caf-bf5d-45ca-b01d-45d722857ffa-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Acquiring lock "cinder-quobyte-091e2caf-bf5d-45ca-b01d-45d722857ffa" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Lock "cinder-quobyte-091e2caf-bf5d-45ca-b01d-45d722857ffa" acquired by "delete_volume" :: waited 0.074s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cdfcc4-d7a1-479a-b039-30fbcc7f5b91]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:38 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa Jul 10 19:39:38 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:38 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.353s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (d485eaa1-f8dc-447d-8c60-478ba140931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd61ee9-6432-4d59-81c1-6e564a464ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 8 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd61ee9-6432-4d59-81c1-6e564a464ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1976432641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c9eb3e-1751-4f24-8b75-390cb5ade42c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3e3552a9-2658-4c1a-b05d-4954ea238e8c,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:39Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b1a00a-4a30-4be0-9937-33e0beed2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b1a00a-4a30-4be0-9937-33e0beed2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7002276f-3215-467a-a6e4-30c7cbdba418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7002276f-3215-467a-a6e4-30c7cbdba418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '76c9eb3e-1751-4f24-8b75-390cb5ade42c', 'volume_name': 'volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c', 'volume_size': 1, 'source_volid': '3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'source_volstatus': 'available'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f1c149-afdb-4911-b3c8-0b390cdae172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f1c149-afdb-4911-b3c8-0b390cdae172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e350f0b0-65b2-4245-a560-b296b6806e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:38 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Volume 76c9eb3e-1751-4f24-8b75-390cb5ade42c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c', 'volume_size': 1, 'source_volid': '3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'source_volstatus': 'available'} Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:39 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Cloning volume 3e3552a9-2658-4c1a-b05d-4954ea238e8c to volume 76c9eb3e-1751-4f24-8b75-390cb5ade42c Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Creating offline snapshot 494f6105-4e07-47cb-b683-82e2efb57021 of volume 3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa353d6-4543-423c-a664-80661bd1aa2c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:39 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:39:39 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:39 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa" returned: 0 in 1.153s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:39 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa Jul 10 19:39:39 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:39 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 0.918s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:40 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 1G Jul 10 19:39:40 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Acquiring lock "cinder-4a6bf4e4-8c63-4e5e-bd85-431235bad166-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "cinder-4a6bf4e4-8c63-4e5e-bd85-431235bad166-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Acquiring lock "cinder-quobyte-4a6bf4e4-8c63-4e5e-bd85-431235bad166" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "cinder-quobyte-4a6bf4e4-8c63-4e5e-bd85-431235bad166" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[343fb011-94d0-4555-8c7e-c8a40f1ac03a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:40 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 Jul 10 19:39:40 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:40 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-091e2caf-bf5d-45ca-b01d-45d722857ffa" returned: 0 in 0.930s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Lock "cinder-quobyte-091e2caf-bf5d-45ca-b01d-45d722857ffa" released by "delete_volume" :: held 2.195s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Created reservations ['bbe93e4b-cd8d-4ba8-a628-3cb1dd423462', 'd85fd84f-e6c7-46e1-997a-4e51a4d55c30', 'b8ae5321-5a97-40e1-9395-2a6c9422401a', '8b83d2d4-0b95-4440-8fc9-11f9dce137fe'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:40 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:39:40 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:41 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 1G" returned: 0 in 1.220s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:41 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166" returned: 0 in 0.961s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:41 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 Jul 10 19:39:41 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:41 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166 Jul 10 19:39:41 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:41 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.118s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:41 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:39:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Deleted volume successfully. Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e19591-465e-446c-9ad3-7c7cd5e92db4 tempest-VolumeQuotasAdminTestJSON-1567741493 None] Lock "cinder-091e2caf-bf5d-45ca-b01d-45d722857ffa-delete_volume" released by "delete_volume" :: held 3.770s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:42 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021" returned: 0 in 1.085s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:42 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 is being set with open permissions: ugo+rw Jul 10 19:39:42 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a6bf4e4-8c63-4e5e-bd85-431235bad166" returned: 0 in 1.070s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:42 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 Jul 10 19:39:42 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "cinder-quobyte-4a6bf4e4-8c63-4e5e-bd85-431235bad166" released by "delete_volume" :: held 2.112s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Created reservations ['33cc72dd-e14d-412a-9a6e-57c70a7622db', '82862130-3bd6-436a-97de-aaffa128f252', '77222b4e-83be-407e-9cf6-3faf14eb5c4d', 'a1cc8cc8-638d-414d-b3a9-5297c8e6fa2f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:42 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:39:42 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:43 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021" returned: 0 in 1.015s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:43 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.855s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:43 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:39:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Deleted volume successfully. Jul 10 19:39:43 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info Jul 10 19:39:43 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c55df1cc-140e-4f84-b021-73c374940b80 tempest-ServerRescueNegativeTestJSON-846666165 None] Lock "cinder-4a6bf4e4-8c63-4e5e-bd85-431235bad166-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:44 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:44 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info is being set with open permissions: ugo+rw Jul 10 19:39:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:44 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info Jul 10 19:39:44 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:45 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.info" returned: 0 in 1.261s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-76c9eb3e-1751-4f24-8b75-390cb5ade42c" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-76c9eb3e-1751-4f24-8b75-390cb5ade42c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] snapshot: 494f6105-4e07-47cb-b683-82e2efb57021, volume: 76c9eb3e-1751-4f24-8b75-390cb5ade42c, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5350d445-04a0-4032-bc5e-295fc1a1ce21]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:45 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 Jul 10 19:39:45 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:46 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021" returned: 0 in 1.199s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:39:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:39:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:39:46 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[797d6b66-b780-419f-9c4d-be08fdcf40ec]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:46 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:39:46 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:48 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 1.347s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:48 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:39:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:48 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c Jul 10 19:39:48 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Flow 'volume_create_manager' (48d11747-1926-47ac-8dac-890fe5e66a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e121bc-cdfe-47b0-a93e-46aa316d8c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e121bc-cdfe-47b0-a93e-46aa316d8c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-739147945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22cdc1f-8207-43e0-800a-46f9cabef98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c9d4983144495485be049b43c48897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:52Z,use_quota=True,user_id='f9f972aced7b4961a1a41c4dd575d663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbe4e30-9613-4915-b370-8a3f3d7fff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbe4e30-9613-4915-b370-8a3f3d7fff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3df2e7f-5cf9-4775-ad68-f7b700fcc0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3df2e7f-5cf9-4775-ad68-f7b700fcc0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22cdc1f-8207-43e0-800a-46f9cabef98e', 'volume_name': 'volume-e22cdc1f-8207-43e0-800a-46f9cabef98e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36606f8f-7ad3-4f2b-a903-333614e198d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36606f8f-7ad3-4f2b-a903-333614e198d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318aab52-9737-4a26-a705-e8827a559d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:51 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Volume e22cdc1f-8207-43e0-800a-46f9cabef98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22cdc1f-8207-43e0-800a-46f9cabef98e', 'volume_size': 1} Jul 10 19:39:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:55 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c" returned: 0 in 7.252s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f1f22-332c-42e2-b9a7-7417c986dff4]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:55 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:39:55 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Flow 'volume_create_manager' (951f6749-397f-4eda-a853-df25da302bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f70164-81f8-4339-a109-aa541ace637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f70164-81f8-4339-a109-aa541ace637f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-329935687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94316588-7de4-483c-b00e-91c078f064cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e7f0c957f34b87a3be93a1fd1c6fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:56Z,use_quota=True,user_id='b86bf0459e994341ad6898a08719d839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef0a0ad6-eb86-4e16-b41c-2198d2845eff),volume_type_id=ef0a0ad6-eb86-4e16-b41c-2198d2845eff)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30bcbf4-67a2-4993-9984-a22485ea1879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30bcbf4-67a2-4993-9984-a22485ea1879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f08e20-8f29-4c7d-b284-aeea84957955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f08e20-8f29-4c7d-b284-aeea84957955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94316588-7de4-483c-b00e-91c078f064cb', 'volume_name': 'volume-94316588-7de4-483c-b00e-91c078f064cb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0d79cf-8c45-4374-8a3d-2bf05b75ac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0d79cf-8c45-4374-8a3d-2bf05b75ac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a36b71-7845-40b8-ae27-43c865da7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:39:55 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Volume 94316588-7de4-483c-b00e-91c078f064cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94316588-7de4-483c-b00e-91c078f064cb', 'volume_size': 1} Jul 10 19:39:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:39:56 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 0.942s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:56 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:39:56 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Converted 1024.00 MB image at 141.18 MB/s Jul 10 19:39:56 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c is being set with open permissions: ugo+rw Jul 10 19:39:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:56 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c Jul 10 19:39:56 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:56 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c" returned: 0 in 0.629s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-76c9eb3e-1751-4f24-8b75-390cb5ade42c" released by "_copy_volume_from_snapshot" :: held 11.491s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:39:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-494f6105-4e07-47cb-b683-82e2efb57021" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-494f6105-4e07-47cb-b683-82e2efb57021" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Deleting offline snapshot 494f6105-4e07-47cb-b683-82e2efb57021 of volume 3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] snapshot_file for this snap is: volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a5b0c-a7e3-4dea-b33f-ab81abafd6da]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:57 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 Jul 10 19:39:57 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:57 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021" returned: 0 in 0.766s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36e5ce4-17b1-481f-a0a2-e07fef4d6628]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:39:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:57 devstack sudo[92283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:39:57 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:58 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:58 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 Jul 10 19:39:58 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:39:59 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 10 19:39:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:39:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:39:59 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021 Jul 10 19:39:59 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:00 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c.494f6105-4e07-47cb-b683-82e2efb57021" returned: 0 in 0.678s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-494f6105-4e07-47cb-b683-82e2efb57021" released by "_delete_snapshot" :: held 3.045s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.094s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.221s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-739147945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22cdc1f-8207-43e0-800a-46f9cabef98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c9d4983144495485be049b43c48897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:52Z,use_quota=True,user_id='f9f972aced7b4961a1a41c4dd575d663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Creating volume e22cdc1f-8207-43e0-800a-46f9cabef98e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:00 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e350f0b0-65b2-4245-a560-b296b6806e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c', 'volume_size': 1, 'source_volid': '3e3552a9-2658-4c1a-b05d-4954ea238e8c', 'source_volstatus': 'available'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf914c2b-a22e-4733-b8f3-9030698b9760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:00 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e 1073741824 Jul 10 19:40:00 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Volume volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c (76c9eb3e-1751-4f24-8b75-390cb5ade42c): created successfully Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf914c2b-a22e-4733-b8f3-9030698b9760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (d485eaa1-f8dc-447d-8c60-478ba140931a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-366c9bae-996d-4a84-9416-c8e429f0c9db tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:40:01 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e 1073741824" returned: 0 in 0.952s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (e25b85ac-8891-4736-bc64-6d5b6736ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082977bf-bda0-4c5b-bbae-7c221f3790d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082977bf-bda0-4c5b-bbae-7c221f3790d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2065596480',display_name='tempest-VolumesGetTest-Volume-787788642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408a969-cf53-4154-8e33-9ccd4b4e4322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:01Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81936b5-89ae-44eb-97df-c541c804324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81936b5-89ae-44eb-97df-c541c804324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5e80c1-5b43-45e7-a51f-1b96c22455d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5e80c1-5b43-45e7-a51f-1b96c22455d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e408a969-cf53-4154-8e33-9ccd4b4e4322', 'volume_name': 'volume-e408a969-cf53-4154-8e33-9ccd4b4e4322', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e96c48-43e9-4cd8-b70f-336a65a8e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e96c48-43e9-4cd8-b70f-336a65a8e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f298f59b-a0f2-4764-a443-fdea226c68af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:01 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Volume e408a969-cf53-4154-8e33-9ccd4b4e4322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e408a969-cf53-4154-8e33-9ccd4b4e4322', 'volume_size': 1} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:01 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e Jul 10 19:40:01 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:01 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e" returned: 0 in 0.693s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.212s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-329935687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94316588-7de4-483c-b00e-91c078f064cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e7f0c957f34b87a3be93a1fd1c6fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:39:56Z,use_quota=True,user_id='b86bf0459e994341ad6898a08719d839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef0a0ad6-eb86-4e16-b41c-2198d2845eff),volume_type_id=ef0a0ad6-eb86-4e16-b41c-2198d2845eff)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Creating volume 94316588-7de4-483c-b00e-91c078f064cb {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:01 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318aab52-9737-4a26-a705-e8827a559d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22cdc1f-8207-43e0-800a-46f9cabef98e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:01 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb 1073741824 Jul 10 19:40:01 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2999c38-aeda-4685-b599-bb7cbdeddec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:01 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Volume volume-e22cdc1f-8207-43e0-800a-46f9cabef98e (e22cdc1f-8207-43e0-800a-46f9cabef98e): created successfully Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2999c38-aeda-4685-b599-bb7cbdeddec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Flow 'volume_create_manager' (48d11747-1926-47ac-8dac-890fe5e66a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-495364e1-1511-4970-8fc7-9bee9d7ca337 tempest-AttachVolumeShelveTestJSON-84275663 None] Created volume successfully. Jul 10 19:40:02 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb 1073741824" returned: 0 in 0.982s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:02 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb Jul 10 19:40:02 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:03 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.409s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2065596480',display_name='tempest-VolumesGetTest-Volume-787788642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e408a969-cf53-4154-8e33-9ccd4b4e4322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:01Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Creating volume e408a969-cf53-4154-8e33-9ccd4b4e4322 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:03 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:03 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 1073741824 Jul 10 19:40:03 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a36b71-7845-40b8-ae27-43c865da7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94316588-7de4-483c-b00e-91c078f064cb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b951b6-dea0-4593-9383-2b4218b42767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:03 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Volume volume-94316588-7de4-483c-b00e-91c078f064cb (94316588-7de4-483c-b00e-91c078f064cb): created successfully Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b951b6-dea0-4593-9383-2b4218b42767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Flow 'volume_create_manager' (951f6749-397f-4eda-a853-df25da302bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:03 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-94d658f3-03e8-4aad-934f-77bda5e3dcf8 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Created volume successfully. Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:04 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:04 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:04 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 1073741824" returned: 0 in 1.077s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:04 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 Jul 10 19:40:04 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:05 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bf3507d0-ce26-4cbc-8c30-eea3d834a278 tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Retype volume completed successfully. Jul 10 19:40:05 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322" returned: 0 in 0.802s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f298f59b-a0f2-4764-a443-fdea226c68af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e408a969-cf53-4154-8e33-9ccd4b4e4322', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d57218-b175-4cde-acdd-a8c3598c5a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Volume volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 (e408a969-cf53-4154-8e33-9ccd4b4e4322): created successfully Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d57218-b175-4cde-acdd-a8c3598c5a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (e25b85ac-8891-4736-bc64-6d5b6736ae22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ee8ac8e2-72d9-47b3-a832-43b92376be96 tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Acquiring lock "cinder-94316588-7de4-483c-b00e-91c078f064cb-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "cinder-94316588-7de4-483c-b00e-91c078f064cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Acquiring lock "cinder-quobyte-94316588-7de4-483c-b00e-91c078f064cb" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "cinder-quobyte-94316588-7de4-483c-b00e-91c078f064cb" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf5f45-4040-4a2a-b1cc-3bc86b3fa581]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:05 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb Jul 10 19:40:05 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-e408a969-cf53-4154-8e33-9ccd4b4e4322-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Lock "cinder-e408a969-cf53-4154-8e33-9ccd4b4e4322-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-e408a969-cf53-4154-8e33-9ccd4b4e4322" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-e408a969-cf53-4154-8e33-9ccd4b4e4322" acquired by "delete_volume" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bbbe11-42df-4025-8c6d-31b92a0e2619]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:06 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb" returned: 0 in 0.890s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:06 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb Jul 10 19:40:06 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:06 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 Jul 10 19:40:06 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:07 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94316588-7de4-483c-b00e-91c078f064cb" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "cinder-quobyte-94316588-7de4-483c-b00e-91c078f064cb" released by "delete_volume" :: held 1.730s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=64,cinder:UPDATE=79,cinder:DELETE=8,cinder:INSERT=11 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:40:07 devstack cinder-volume[87164]: WARNING cinder.quota [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:40:07 devstack cinder-volume[87164]: WARNING cinder.quota [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Created reservations ['364268e1-ce03-4a0d-9782-2342def2e900', '35d7beed-81d9-436e-93ac-f59f02ba0ed5', '0cfaa43d-c9ea-4f87-bd0d-77fd1978d8a6', 'b5abbd76-50ee-4231-9aed-03827d3d49ef'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:07 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322" returned: 0 in 0.922s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:07 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322 Jul 10 19:40:07 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=76,cinder:SELECT=57,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:07 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:07 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:08 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.802s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Deleted volume successfully. Jul 10 19:40:08 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e408a969-cf53-4154-8e33-9ccd4b4e4322" returned: 0 in 0.951s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-e408a969-cf53-4154-8e33-9ccd4b4e4322" released by "delete_volume" :: held 1.940s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-64cc96d0-0cd1-4772-bc4b-88cf3038c2bd tempest-VolumeRetypeWithoutMigrationTest-1582398216 None] Lock "cinder-94316588-7de4-483c-b00e-91c078f064cb-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Created reservations ['8f7a546f-edf9-486d-8c01-d8824613a985', '99296ff1-4b14-4640-b227-e89c1ade6e75', '0b515e97-40fc-475e-923f-fdb276fac859', 'c8ffb162-2139-48aa-8e66-ddcce0e0d45e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:08 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:08 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-76c9eb3e-1751-4f24-8b75-390cb5ade42c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Lock "cinder-76c9eb3e-1751-4f24-8b75-390cb5ade42c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-76c9eb3e-1751-4f24-8b75-390cb5ade42c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-76c9eb3e-1751-4f24-8b75-390cb5ade42c" acquired by "delete_volume" :: waited 0.039s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[05feaf14-52c8-42ab-9c5f-471087e052be]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:09 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c Jul 10 19:40:09 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:09 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.907s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:40:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b789e0f8-0210-4a8a-a4ff-badc4e22197f tempest-VolumesGetTest-1784068748 None] Lock "cinder-e408a969-cf53-4154-8e33-9ccd4b4e4322-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:10 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c" returned: 0 in 1.180s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:10 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c Jul 10 19:40:10 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:11 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-76c9eb3e-1751-4f24-8b75-390cb5ade42c" returned: 0 in 0.786s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-76c9eb3e-1751-4f24-8b75-390cb5ade42c" released by "delete_volume" :: held 2.034s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Created reservations ['01f43905-3223-4481-932c-dbfadb285d9c', '17019f09-99dc-45c8-b154-772f330ce4f7', '99222e8a-4485-47af-ba47-5e5322236764', '7d723b1d-3cc7-48ee-93e6-e2d2aa602da8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:11 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:11 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:12 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.248s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-3e3552a9-2658-4c1a-b05d-4954ea238e8c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2b420e5b-3add-4f37-8974-f0974808230b tempest-VolumesGetTest-1784068748 None] Lock "cinder-76c9eb3e-1751-4f24-8b75-390cb5ade42c-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Lock "cinder-3e3552a9-2658-4c1a-b05d-4954ea238e8c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-3e3552a9-2658-4c1a-b05d-4954ea238e8c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-3e3552a9-2658-4c1a-b05d-4954ea238e8c" acquired by "delete_volume" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c8e838-d6dc-48c0-9cc9-b46610b6a150]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:13 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:40:13 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:13 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 0.978s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:13 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c Jul 10 19:40:13 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:14 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e3552a9-2658-4c1a-b05d-4954ea238e8c" returned: 0 in 0.763s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-3e3552a9-2658-4c1a-b05d-4954ea238e8c" released by "delete_volume" :: held 1.835s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Created reservations ['ec295df1-cfee-4c1f-88f4-e15ccdbb8f2e', 'bd8b44e0-f0db-4a97-abaa-ce1a4db38d2e', '1884e4ba-0628-4415-90de-9c7f1f3fc35a', '5898be66-957c-46f3-b7ea-e4e74b9bbece'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:14 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:14 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:15 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.029s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:15 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:40:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9d68af0d-d197-41e8-9a6b-2ac33f7d47a2 tempest-VolumesGetTest-1784068748 None] Lock "cinder-3e3552a9-2658-4c1a-b05d-4954ea238e8c-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Flow 'volume_create_manager' (0b59fc17-e250-4995-9b19-e41b484966e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184fed4b-9446-4829-b7d7-ef5013bbe188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184fed4b-9446-4829-b7d7-ef5013bbe188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1172226685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df09f11-d2db-4d04-a59f-98d1e76054e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66d4db1cab24a73bb0867ccae2405bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:16Z,use_quota=True,user_id='4a1d330d88b540c9bc88f59e9bf8d7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b11d34d-c267-44ea-ad50-5dcd69aad531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b11d34d-c267-44ea-ad50-5dcd69aad531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e48057-0f23-4730-9f93-bcaee2d0d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e48057-0f23-4730-9f93-bcaee2d0d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df09f11-d2db-4d04-a59f-98d1e76054e0', 'volume_name': 'volume-7df09f11-d2db-4d04-a59f-98d1e76054e0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c05655-ca51-4ab2-af49-3d91c549f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c05655-ca51-4ab2-af49-3d91c549f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325017d8-3a9c-4e59-817e-25c072101dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Volume 7df09f11-d2db-4d04-a59f-98d1e76054e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df09f11-d2db-4d04-a59f-98d1e76054e0', 'volume_size': 1} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1172226685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df09f11-d2db-4d04-a59f-98d1e76054e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66d4db1cab24a73bb0867ccae2405bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:16Z,use_quota=True,user_id='4a1d330d88b540c9bc88f59e9bf8d7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Creating volume 7df09f11-d2db-4d04-a59f-98d1e76054e0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:16 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:16 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 1073741824 Jul 10 19:40:16 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (3f3dad9c-df67-4f68-a3da-4c45ac0a1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1214584-14f4-4cdd-87d3-e93878d87419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1214584-14f4-4cdd-87d3-e93878d87419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1521210962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f809b1-1c0b-41d9-81ac-74783073eb6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:17Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac266fde-519f-495d-abac-d4d8acdb28ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac266fde-519f-495d-abac-d4d8acdb28ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b80a1ae-8101-4f50-8817-0391593020d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:16 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:40:17 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 1073741824" returned: 0 in 1.042s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:17 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 Jul 10 19:40:17 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b80a1ae-8101-4f50-8817-0391593020d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25f809b1-1c0b-41d9-81ac-74783073eb6c', 'volume_name': 'volume-25f809b1-1c0b-41d9-81ac-74783073eb6c', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00da0132-28bb-47d6-8774-c49b6c73e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00da0132-28bb-47d6-8774-c49b6c73e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df37375-7344-4c70-a130-b3bd16b35dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:17 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Volume 25f809b1-1c0b-41d9-81ac-74783073eb6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25f809b1-1c0b-41d9-81ac-74783073eb6c', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 19:40:17 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Trying to clone 25f809b1-1c0b-41d9-81ac-74783073eb6c from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:40:18 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Image download 20.69 MB at 20.69 MB/s Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ff0b0-d1f3-44fe-b161-e79784d1063b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:18 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:18 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD Jul 10 19:40:18 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0" returned: 0 in 1.167s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325017d8-3a9c-4e59-817e-25c072101dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df09f11-d2db-4d04-a59f-98d1e76054e0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a376cbd-0357-43ec-9844-3519b7ddcfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:18 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Volume volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 (7df09f11-d2db-4d04-a59f-98d1e76054e0): created successfully Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a376cbd-0357-43ec-9844-3519b7ddcfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Flow 'volume_create_manager' (0b59fc17-e250-4995-9b19-e41b484966e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-db131587-c313-4416-9384-f0ff2c99aab3 tempest-VolumesListAdminTestJSON-1804114420 None] Created volume successfully. Jul 10 19:40:19 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD" returned: 0 in 1.174s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:19 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f is fetched for user bd44ba64d1ad4cc9821ab4d20fce599b. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:40:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b1af09-352c-4f2f-ae3e-59231d37e361]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:19 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD Jul 10 19:40:19 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Flow 'volume_create_manager' (3a56371e-d883-40ba-ac4b-60e23ab11a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4939830f-29ef-417e-a008-d95da3e7126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4939830f-29ef-417e-a008-d95da3e7126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-413320277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c99862e-802e-4e93-8775-69ea59dc9ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66d4db1cab24a73bb0867ccae2405bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:20Z,use_quota=True,user_id='4a1d330d88b540c9bc88f59e9bf8d7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1597cea-48b5-4d2d-b94f-118a06556ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1597cea-48b5-4d2d-b94f-118a06556ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eb6fd5-1218-4275-8c1a-d7892caa2014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eb6fd5-1218-4275-8c1a-d7892caa2014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c99862e-802e-4e93-8775-69ea59dc9ba1', 'volume_name': 'volume-3c99862e-802e-4e93-8775-69ea59dc9ba1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d807c2-83ae-46bb-a8d9-770604c9fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d807c2-83ae-46bb-a8d9-770604c9fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60df267c-d4a9-4b47-b66e-e8961be6478e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Volume 3c99862e-802e-4e93-8775-69ea59dc9ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c99862e-802e-4e93-8775-69ea59dc9ba1', 'volume_size': 1} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-413320277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c99862e-802e-4e93-8775-69ea59dc9ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66d4db1cab24a73bb0867ccae2405bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:20Z,use_quota=True,user_id='4a1d330d88b540c9bc88f59e9bf8d7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Creating volume 3c99862e-802e-4e93-8775-69ea59dc9ba1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:20 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:20 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 1073741824 Jul 10 19:40:20 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:20 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD" returned: 0 in 0.993s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:21 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 1073741824" returned: 0 in 1.081s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:21 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 Jul 10 19:40:21 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-018603f9-f50f-4376-9d72-406ec717e331 req-c5451f7b-d798-4d45-9efa-abf598549574 tempest-AttachVolumeShelveTestJSON-84275663 None] No connector for attachment f16f4f13-12fe-4d3a-a86d-05c9673d0c38; skipping storage backend terminate_connection call. {{(pid=87164) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 19:40:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-018603f9-f50f-4376-9d72-406ec717e331 req-c5451f7b-d798-4d45-9efa-abf598549574 tempest-AttachVolumeShelveTestJSON-84275663 None] Deleting attachment f16f4f13-12fe-4d3a-a86d-05c9673d0c38. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:40:22 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1" returned: 0 in 0.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1521210962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f809b1-1c0b-41d9-81ac-74783073eb6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:17Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Creating volume 25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:22 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60df267c-d4a9-4b47-b66e-e8961be6478e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c99862e-802e-4e93-8775-69ea59dc9ba1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:22 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c 1073741824 Jul 10 19:40:22 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e4fa44-c813-42d2-bb80-7c0e99d37fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Volume volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 (3c99862e-802e-4e93-8775-69ea59dc9ba1): created successfully Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e4fa44-c813-42d2-bb80-7c0e99d37fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Flow 'volume_create_manager' (3a56371e-d883-40ba-ac4b-60e23ab11a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-310854e2-28c6-4f28-a030-f252d76e65a1 tempest-VolumesListAdminTestJSON-1804114420 None] Created volume successfully. Jul 10 19:40:23 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c 1073741824" returned: 0 in 0.976s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:23 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:23 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Flow 'volume_create_manager' (fee9a124-cf16-46fc-b509-d205f9c84726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e918a3fe-bc6d-4c4c-b106-ee8d26dee4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:23 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 0 in 0.781s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e918a3fe-bc6d-4c4c-b106-ee8d26dee4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949373734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c457f67c-4268-4caa-b462-d8dc90148a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66d4db1cab24a73bb0867ccae2405bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:24Z,use_quota=True,user_id='4a1d330d88b540c9bc88f59e9bf8d7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ce3c70-ea46-4cc0-9e22-b7fab2016efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ce3c70-ea46-4cc0-9e22-b7fab2016efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebd7500-2639-4c39-9b58-620cb97d44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebd7500-2639-4c39-9b58-620cb97d44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c457f67c-4268-4caa-b462-d8dc90148a21', 'volume_name': 'volume-c457f67c-4268-4caa-b462-d8dc90148a21', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285bd954-ab9f-45a0-9188-fd3f4c024d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285bd954-ab9f-45a0-9188-fd3f4c024d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed0b3a-2f7f-408c-818e-9e894299fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Volume c457f67c-4268-4caa-b462-d8dc90148a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c457f67c-4268-4caa-b462-d8dc90148a21', 'volume_size': 1} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949373734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c457f67c-4268-4caa-b462-d8dc90148a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66d4db1cab24a73bb0867ccae2405bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:24Z,use_quota=True,user_id='4a1d330d88b540c9bc88f59e9bf8d7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Creating volume c457f67c-4268-4caa-b462-d8dc90148a21 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:23 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:23 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 1073741824 Jul 10 19:40:23 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:23 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Attempting download of f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume 25f809b1-1c0b-41d9-81ac-74783073eb6c. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:40:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feb3d7d-c8e6-41b6-ab94-db116976bd3c]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:24 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq Jul 10 19:40:24 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:24 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq" returned: 0 in 0.764s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:24 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 1073741824" returned: 0 in 0.909s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:24 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 Jul 10 19:40:24 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:24 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq Jul 10 19:40:24 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:25 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq" returned: 1 in 0.739s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_vw2b8zxq' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19a88e-a6d1-4c66-b390-628c73605fe5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:25 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21" returned: 0 in 0.697s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed0b3a-2f7f-408c-818e-9e894299fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c457f67c-4268-4caa-b462-d8dc90148a21', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b334bc62-d11e-469d-9a0a-6482dfbeded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Volume volume-c457f67c-4268-4caa-b462-d8dc90148a21 (c457f67c-4268-4caa-b462-d8dc90148a21): created successfully Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b334bc62-d11e-469d-9a0a-6482dfbeded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Flow 'volume_create_manager' (fee9a124-cf16-46fc-b509-d205f9c84726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-07ab36ee-f1f9-48d2-b768-cee988cf5e00 tempest-VolumesListAdminTestJSON-1804114420 None] Created volume successfully. Jul 10 19:40:25 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD Jul 10 19:40:25 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:26 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] f6bf008e-8dc3-4605-a3ec-36b1ff11d65f was qcow2, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:26 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:26 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Flow 'volume_create_manager' (b162089d-d155-41a0-aa6d-36c7ba3bfaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84cf222-e96c-4330-9cfe-03dbbbb75731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84cf222-e96c-4330-9cfe-03dbbbb75731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58af45ea-6ee8-408c-95bf-59baffd5948e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ceb36e0c3b45d2809420b295f1068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:27Z,use_quota=True,user_id='47465b5585754a89beb385b705139850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30089f43-9f47-4f98-964e-e59e7ecaf5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30089f43-9f47-4f98-964e-e59e7ecaf5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdd57b5-26e8-4197-be26-3d378ee03eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdd57b5-26e8-4197-be26-3d378ee03eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58af45ea-6ee8-408c-95bf-59baffd5948e', 'volume_name': 'volume-58af45ea-6ee8-408c-95bf-59baffd5948e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bfe092-191e-4813-84ee-6986d71e51ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bfe092-191e-4813-84ee-6986d71e51ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb035d6-ce49-4774-8d84-e424fd9e81b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:26 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Volume 58af45ea-6ee8-408c-95bf-59baffd5948e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58af45ea-6ee8-408c-95bf-59baffd5948e', 'volume_size': 1} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58af45ea-6ee8-408c-95bf-59baffd5948e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ceb36e0c3b45d2809420b295f1068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:27Z,use_quota=True,user_id='47465b5585754a89beb385b705139850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Creating volume 58af45ea-6ee8-408c-95bf-59baffd5948e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:26 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:26 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e 1073741824 Jul 10 19:40:26 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:28 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e 1073741824" returned: 0 in 1.238s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:28 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e Jul 10 19:40:28 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:28 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 0 in 2.638s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:28 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_k7_ke_uddevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:40:28 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Converted 112.00 MB image at 42.43 MB/s Jul 10 19:40:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:29 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c 1G Jul 10 19:40:29 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:29 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e" returned: 0 in 0.970s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb035d6-ce49-4774-8d84-e424fd9e81b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58af45ea-6ee8-408c-95bf-59baffd5948e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9300dc-c93d-4efb-b0fb-ed32ba66d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Volume volume-58af45ea-6ee8-408c-95bf-59baffd5948e (58af45ea-6ee8-408c-95bf-59baffd5948e): created successfully Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9300dc-c93d-4efb-b0fb-ed32ba66d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Flow 'volume_create_manager' (b162089d-d155-41a0-aa6d-36c7ba3bfaa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e4d1fd44-5fa4-4cd9-a82e-87311f89ca9b tempest-VolumesListAdminTestJSON-919725528 None] Created volume successfully. Jul 10 19:40:29 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c 1G" returned: 0 in 0.833s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3180bbb-46b4-4258-a696-10cb7f6433f7]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:30 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:30 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Acquiring lock "cinder-58af45ea-6ee8-408c-95bf-59baffd5948e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Lock "cinder-58af45ea-6ee8-408c-95bf-59baffd5948e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Acquiring lock "cinder-quobyte-58af45ea-6ee8-408c-95bf-59baffd5948e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Lock "cinder-quobyte-58af45ea-6ee8-408c-95bf-59baffd5948e" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c7727-48d4-4f64-93e1-30949004e90f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "cinder-c457f67c-4268-4caa-b462-d8dc90148a21-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-c457f67c-4268-4caa-b462-d8dc90148a21-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "cinder-quobyte-c457f67c-4268-4caa-b462-d8dc90148a21" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-quobyte-c457f67c-4268-4caa-b462-d8dc90148a21" acquired by "delete_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:30 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e Jul 10 19:40:30 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c94969-9ff7-44bb-b2f2-36ff0bc37419]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:30 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 Jul 10 19:40:30 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:30 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 0 in 1.053s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:31 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:31 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:31 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e" returned: 0 in 1.072s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:31 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e Jul 10 19:40:31 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:31 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21" returned: 0 in 0.922s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:31 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21 Jul 10 19:40:31 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:32 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 1 in 1.166s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Downloaded image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume 25f809b1-1c0b-41d9-81ac-74783073eb6c successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f for user bd44ba64d1ad4cc9821ab4d20fce599b is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Marking volume 25f809b1-1c0b-41d9-81ac-74783073eb6c as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Copying metadata from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f to 25f809b1-1c0b-41d9-81ac-74783073eb6c. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Creating volume glance metadata for volume 25f809b1-1c0b-41d9-81ac-74783073eb6c backed by image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:40:32 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-58af45ea-6ee8-408c-95bf-59baffd5948e" returned: 0 in 0.783s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Lock "cinder-quobyte-58af45ea-6ee8-408c-95bf-59baffd5948e" released by "delete_volume" :: held 1.930s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df37375-7344-4c70-a130-b3bd16b35dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f809b1-1c0b-41d9-81ac-74783073eb6c', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b94401-f824-4b49-8f89-5e8296690a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Created reservations ['21610805-bda9-4d2b-a030-58514448b100', 'ac3326d7-b1fe-4000-b4d0-9acb77d78bdd', '5a3dc2fa-4385-4b16-9e3c-a53fda782f1b', '3432d3f6-1386-4dd3-8703-bb8e84419eff'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Volume volume-25f809b1-1c0b-41d9-81ac-74783073eb6c (25f809b1-1c0b-41d9-81ac-74783073eb6c): created successfully Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b94401-f824-4b49-8f89-5e8296690a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (3f3dad9c-df67-4f68-a3da-4c45ac0a1942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9f0b23c9-156a-4500-a2e5-acd44b43cd4b tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:32 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:32 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:32 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c457f67c-4268-4caa-b462-d8dc90148a21" returned: 0 in 0.904s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-quobyte-c457f67c-4268-4caa-b462-d8dc90148a21" released by "delete_volume" :: held 1.905s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Created reservations ['5376f72d-417f-40d0-a2cc-34c00fd804d6', '7d587d2b-4240-4537-b81b-41cd832676dd', '42082859-1ac2-40ef-a760-8a9b15fb5178', '232975e9-d32c-499e-bb92-f529ddb46ea3'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:32 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:32 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "cinder-3c99862e-802e-4e93-8775-69ea59dc9ba1-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-3c99862e-802e-4e93-8775-69ea59dc9ba1-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "cinder-quobyte-3c99862e-802e-4e93-8775-69ea59dc9ba1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-quobyte-3c99862e-802e-4e93-8775-69ea59dc9ba1" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef38dc6f-c9c9-4a13-ab84-0cd2330969dc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:33 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.233s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Deleted volume successfully. Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cd9811a9-d596-4c49-b92e-29d07774ddaf tempest-VolumesListAdminTestJSON-919725528 None] Lock "cinder-58af45ea-6ee8-408c-95bf-59baffd5948e-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:33 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 Jul 10 19:40:33 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:33 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.174s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Deleted volume successfully. Jul 10 19:40:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9350efe-be87-473f-96cc-2097d00ac776 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-c457f67c-4268-4caa-b462-d8dc90148a21-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (3d12ee72-8ba6-442d-bf04-80e6a3db062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a64592-9cd5-445d-9b00-fffb94e582e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a64592-9cd5-445d-9b00-fffb94e582e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1074300862',display_name='tempest-VolumesGetTest-Volume-1545465769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab74ffa-4664-4d57-b575-3ef11c8cdf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:35Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c22d867-0d66-4940-aef8-c6b4e861d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c22d867-0d66-4940-aef8-c6b4e861d51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a551e6-09f5-417f-8cf8-18e481dd36fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a551e6-09f5-417f-8cf8-18e481dd36fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab74ffa-4664-4d57-b575-3ef11c8cdf03', 'volume_name': 'volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae754cf-e70d-4cd2-a70d-830e913bce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae754cf-e70d-4cd2-a70d-830e913bce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d8b2e4-629a-4a8a-a9c9-340d13d5feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:34 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Volume 4ab74ffa-4664-4d57-b575-3ef11c8cdf03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03', 'volume_size': 1} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1074300862',display_name='tempest-VolumesGetTest-Volume-1545465769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab74ffa-4664-4d57-b575-3ef11c8cdf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc13fdb3f7cd486fa9f79503486c4187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:35Z,use_quota=True,user_id='bd44ba64d1ad4cc9821ab4d20fce599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Creating volume 4ab74ffa-4664-4d57-b575-3ef11c8cdf03 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:34 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:35 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1" returned: 0 in 1.618s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:35 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 1073741824 Jul 10 19:40:35 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:35 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1 Jul 10 19:40:35 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:35 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3c99862e-802e-4e93-8775-69ea59dc9ba1" returned: 0 in 0.868s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-quobyte-3c99862e-802e-4e93-8775-69ea59dc9ba1" released by "delete_volume" :: held 2.642s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Created reservations ['f48bec3f-c69e-40c7-a3dd-3e7bb80d08e7', '8506995a-205b-4b26-aca5-971c70dfd4f8', '814de080-0f0b-4b94-be84-33f298b0b1b1', 'b4ee52d0-0e0b-44c2-8766-3b16b41d1137'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:36 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 1073741824" returned: 0 in 1.107s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:36 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:36 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:36 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 Jul 10 19:40:36 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "cinder-7df09f11-d2db-4d04-a59f-98d1e76054e0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-7df09f11-d2db-4d04-a59f-98d1e76054e0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "cinder-quobyte-7df09f11-d2db-4d04-a59f-98d1e76054e0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-quobyte-7df09f11-d2db-4d04-a59f-98d1e76054e0" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:37 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03" returned: 0 in 1.081s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[183781e2-fb41-4799-a080-b8bc3996f02e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d8b2e4-629a-4a8a-a9c9-340d13d5feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6649b0a0-3838-4f74-8da9-4a9705273801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:37 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.189s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Deleted volume successfully. Jul 10 19:40:37 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Volume volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 (4ab74ffa-4664-4d57-b575-3ef11c8cdf03): created successfully Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6649b0a0-3838-4f74-8da9-4a9705273801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Flow 'volume_create_manager' (3d12ee72-8ba6-442d-bf04-80e6a3db062e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d939b552-ec79-4f67-b14b-8b2f69673ca9 tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-3c99862e-802e-4e93-8775-69ea59dc9ba1-delete_volume" released by "delete_volume" :: held 4.327s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-adacf44d-01bd-46bd-999f-6a6fdee733be tempest-VolumesGetTest-1784068748 None] Created volume successfully. Jul 10 19:40:37 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 Jul 10 19:40:37 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:37 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:37 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-4ab74ffa-4664-4d57-b575-3ef11c8cdf03-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Lock "cinder-4ab74ffa-4664-4d57-b575-3ef11c8cdf03-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-4ab74ffa-4664-4d57-b575-3ef11c8cdf03" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-4ab74ffa-4664-4d57-b575-3ef11c8cdf03" acquired by "delete_volume" :: waited 0.037s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[74432e99-65ed-48f7-97b0-d0c6a7616194]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:38 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0" returned: 0 in 1.497s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:38 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 Jul 10 19:40:38 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:38 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0 Jul 10 19:40:38 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:38 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.380s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:40:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:40:39 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7df09f11-d2db-4d04-a59f-98d1e76054e0" returned: 0 in 0.995s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-quobyte-7df09f11-d2db-4d04-a59f-98d1e76054e0" released by "delete_volume" :: held 2.574s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:39 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Created reservations ['46eeac79-9138-4d92-a35a-873e9fb9b3e6', '8c08ef0a-e7aa-4fd3-995f-a4ea4a5c5232', '88882dd8-86f3-4f3a-823b-d7847acb4d77', 'b7029524-c1e8-4b8e-b117-caed115437b7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:40 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03" returned: 0 in 1.455s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:40 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03 Jul 10 19:40:40 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:40 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:40 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:40 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab74ffa-4664-4d57-b575-3ef11c8cdf03" returned: 0 in 0.738s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-4ab74ffa-4664-4d57-b575-3ef11c8cdf03" released by "delete_volume" :: held 2.300s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:40 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Created reservations ['e2018dce-3df8-46d2-8802-58c181d683ed', 'eb649990-4cc7-464e-bbec-f1fb23e1fef8', 'c175bf1c-1808-4e66-acfc-7eba2772862e', '5c898b48-a6be-483b-b671-0de0e4591971'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:41 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:41 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:41 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.039s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Deleted volume successfully. Jul 10 19:40:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-632e35c4-316f-45d6-919c-c3dcc422ecad tempest-VolumesListAdminTestJSON-1804114420 None] Lock "cinder-7df09f11-d2db-4d04-a59f-98d1e76054e0-delete_volume" released by "delete_volume" :: held 4.221s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:42 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.108s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-25f809b1-1c0b-41d9-81ac-74783073eb6c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Lock "cinder-25f809b1-1c0b-41d9-81ac-74783073eb6c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Acquiring lock "cinder-quobyte-25f809b1-1c0b-41d9-81ac-74783073eb6c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bee09123-0672-40e1-9ff5-53a10ae3711e tempest-VolumesGetTest-1784068748 None] Lock "cinder-4ab74ffa-4664-4d57-b575-3ef11c8cdf03-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-25f809b1-1c0b-41d9-81ac-74783073eb6c" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce8791-c65d-4929-9e4c-8e7186669ce9]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:42 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:42 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:44 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 0 in 1.628s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:44 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:44 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:45 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 1 in 1.393s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:40:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:45 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c Jul 10 19:40:45 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:46 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-25f809b1-1c0b-41d9-81ac-74783073eb6c" returned: 0 in 1.354s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Lock "cinder-quobyte-25f809b1-1c0b-41d9-81ac-74783073eb6c" released by "delete_volume" :: held 4.570s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Created reservations ['1c1b954e-da26-4256-a0cb-6b15f64111c7', '5fa0ceb9-6b52-4bfa-9eca-bde898d305e4', '33c600b6-0df7-423f-beee-ca8c1224bf41', 'a8b8afed-873c-407c-9bc8-54dd5dbb0a9f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:47 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:40:47 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:49 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 2.070s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:49 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:40:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Deleted volume successfully. Jul 10 19:40:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60de1f31-cdd2-4beb-bfdd-49606d94fd4c tempest-VolumesGetTest-1784068748 None] Lock "cinder-25f809b1-1c0b-41d9-81ac-74783073eb6c-delete_volume" released by "delete_volume" :: held 7.228s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Flow 'volume_create_manager' (00d14c75-7c49-4db2-b96f-ebd3480aed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66efce9-99b6-4d91-99c3-77dd9bb1ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66efce9-99b6-4d91-99c3-77dd9bb1ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1651132954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba63d9-07b5-43fc-9ff1-2db61213e2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee49d0b6b0254d3caab4428ab47feb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:53Z,use_quota=True,user_id='c47e40089bf1435b829d83aac42f50d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2691448a-70d9-41ac-bfd5-9045731abd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2691448a-70d9-41ac-bfd5-9045731abd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb99181-9e77-46ac-a855-ca5bd972ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb99181-9e77-46ac-a855-ca5bd972ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbba63d9-07b5-43fc-9ff1-2db61213e2b5', 'volume_name': 'volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfbd401-c804-45ea-b446-654a5df26493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfbd401-c804-45ea-b446-654a5df26493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0986c3-2eb7-409a-97a0-141991aff2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5', 'volume_size': 1} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1651132954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba63d9-07b5-43fc-9ff1-2db61213e2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee49d0b6b0254d3caab4428ab47feb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:53Z,use_quota=True,user_id='c47e40089bf1435b829d83aac42f50d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Creating volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:53 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:53 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 1073741824 Jul 10 19:40:53 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Flow 'volume_create_manager' (cc68badc-6438-47a5-b008-883d2e5753e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e0b4f7-004e-45cc-82ca-55214bc5d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e0b4f7-004e-45cc-82ca-55214bc5d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-949605158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021d7da71f24343b2099f0e6698589a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:54Z,use_quota=True,user_id='32539ca9d27c4e89bd22486d5bbb79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff972424-b5fd-4ede-8eb5-44d2275ceef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff972424-b5fd-4ede-8eb5-44d2275ceef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abb7727-6161-4e55-b3f0-981da4e6aaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abb7727-6161-4e55-b3f0-981da4e6aaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08', 'volume_name': 'volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6001eb62-b5b9-4bed-ab55-5e5a16fbba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6001eb62-b5b9-4bed-ab55-5e5a16fbba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b3ea2b-6831-4fb1-be99-351f771ad20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:53 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Volume 4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08', 'volume_size': 1} Jul 10 19:40:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:54 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 1073741824" returned: 0 in 1.154s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:54 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 Jul 10 19:40:54 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:55 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-949605158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021d7da71f24343b2099f0e6698589a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:40:54Z,use_quota=True,user_id='32539ca9d27c4e89bd22486d5bbb79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Creating volume 4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:40:55 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0986c3-2eb7-409a-97a0-141991aff2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:55 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 1073741824 Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1ad0de-6680-4089-a5a9-8dc362bf8ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:55 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:55 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Volume volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 (cbba63d9-07b5-43fc-9ff1-2db61213e2b5): created successfully Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1ad0de-6680-4089-a5a9-8dc362bf8ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Flow 'volume_create_manager' (00d14c75-7c49-4db2-b96f-ebd3480aed3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:55 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-acdfbf9c-90d5-48fc-a854-fd3940f7f58e tempest-VolumesSnapshotListTestJSON-246840896 None] Created volume successfully. Jul 10 19:40:56 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 1073741824" returned: 0 in 0.950s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:56 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 Jul 10 19:40:56 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:57 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" returned: 0 in 0.887s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.607s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Creating offline snapshot 3881324a-8acc-43b7-a5fb-7b32251c2bc6 of volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b3ea2b-6831-4fb1-be99-351f771ad20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fec4ba-8824-41bb-8f8c-25d5a892aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4dc18-764c-4788-a463-c0cac5712121]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:57 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Volume volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 (4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08): created successfully Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fec4ba-8824-41bb-8f8c-25d5a892aa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:40:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Flow 'volume_create_manager' (cc68badc-6438-47a5-b008-883d2e5753e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:40:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1fe8ad0b-7310-4742-9c73-059ff1c1882a tempest-VolumesDeleteCascade-1834376857 None] Created volume successfully. Jul 10 19:40:57 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 Jul 10 19:40:57 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:58 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" returned: 0 in 1.025s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:58 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 1G Jul 10 19:40:58 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:40:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:40:59 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 10 19:40:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 1G" returned: 0 in 1.401s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:40:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:40:59 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:40:59 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:00 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 0.860s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:00 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 is being set with open permissions: ugo+rw Jul 10 19:41:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:00 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:41:00 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:01 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 0.674s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:01 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info Jul 10 19:41:01 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:01 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info" returned: 0 in 0.740s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:01 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info is being set with open permissions: ugo+rw Jul 10 19:41:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:01 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info Jul 10 19:41:01 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:02 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.info" returned: 0 in 0.695s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.489s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.074s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Creating offline snapshot 031c4a81-41d5-49b4-ac8e-8194f97fa707 of volume 4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[09605786-0691-453a-8fed-e2205e88e2d9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c651ba49-05a9-40e1-a294-bfcf9ff29992 tempest-VolumesSnapshotListTestJSON-246840896 None] Create snapshot completed successfully Jul 10 19:41:02 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 Jul 10 19:41:02 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:03 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" returned: 0 in 0.779s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:03 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 1G Jul 10 19:41:03 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:04 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 1G" returned: 0 in 0.845s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:04 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:04 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:04 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:04 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 is being set with open permissions: ugo+rw Jul 10 19:41:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:04 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:04 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:05 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.668s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:05 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info Jul 10 19:41:05 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:06 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:06 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info is being set with open permissions: ugo+rw Jul 10 19:41:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:06 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info Jul 10 19:41:06 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:06 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.info" returned: 0 in 0.707s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.135s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Creating offline snapshot 42c24925-2613-4cd5-9fe5-613793a8f0a3 of volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e690665-c022-430b-8916-1f1f71c96104]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:07 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dfb9e002-09f4-4941-ad9f-7a1c7aed761f tempest-VolumesDeleteCascade-1834376857 None] Create snapshot completed successfully Jul 10 19:41:07 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:41:07 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Flow 'volume_create_manager' (bb4f1d04-d401-4bfa-8460-864c5e40a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b054acbf-9acf-4f44-9afc-a34c7448af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=119,cinder:SELECT=74,cinder:DELETE=10,cinder:INSERT=31 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b054acbf-9acf-4f44-9afc-a34c7448af3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-951431287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835c463d-c6b1-4f94-8614-1b1ae43006de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3d37c34cc4f7083114e682a8ab216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:08Z,use_quota=True,user_id='a651e860b3924441abe6d163aa319bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e83a6c-a909-451c-a3c9-5b845570cb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e83a6c-a909-451c-a3c9-5b845570cb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0357e6c-7722-4404-9ce3-a36eb2eb5266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0357e6c-7722-4404-9ce3-a36eb2eb5266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835c463d-c6b1-4f94-8614-1b1ae43006de', 'volume_name': 'volume-835c463d-c6b1-4f94-8614-1b1ae43006de', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e008b12d-f1eb-4a49-9f41-d34c814f2fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e008b12d-f1eb-4a49-9f41-d34c814f2fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5dae2f-c700-4967-b5b2-5b5fa155b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:07 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Volume 835c463d-c6b1-4f94-8614-1b1ae43006de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835c463d-c6b1-4f94-8614-1b1ae43006de', 'volume_size': 1} Jul 10 19:41:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:08 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 0.950s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=85,cinder:INSERT=28,cinder:UPDATE=98,cinder:DELETE=10 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:41:08 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 1G Jul 10 19:41:08 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:08 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 1G" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:08 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:08 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:09 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 0.742s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:09 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 is being set with open permissions: ugo+rw Jul 10 19:41:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:09 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:09 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:10 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 0.670s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.314s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-951431287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835c463d-c6b1-4f94-8614-1b1ae43006de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3d37c34cc4f7083114e682a8ab216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:08Z,use_quota=True,user_id='a651e860b3924441abe6d163aa319bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Creating volume 835c463d-c6b1-4f94-8614-1b1ae43006de {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:41:10 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:41:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:10 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de 1073741824 Jul 10 19:41:10 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b7b41376-ba94-4714-91a6-d6642194c5f7 tempest-VolumesSnapshotListTestJSON-246840896 None] Create snapshot completed successfully Jul 10 19:41:11 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de 1073741824" returned: 0 in 0.837s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:11 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de Jul 10 19:41:11 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:12 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de" returned: 0 in 0.875s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.981s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5dae2f-c700-4967-b5b2-5b5fa155b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835c463d-c6b1-4f94-8614-1b1ae43006de', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed82248-c48a-406a-8151-236789a10250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Creating offline snapshot 02d229c2-3041-4e7a-aa95-f5a09e1d3a75 of volume 4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:41:12 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Volume volume-835c463d-c6b1-4f94-8614-1b1ae43006de (835c463d-c6b1-4f94-8614-1b1ae43006de): created successfully Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed82248-c48a-406a-8151-236789a10250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Flow 'volume_create_manager' (bb4f1d04-d401-4bfa-8460-864c5e40a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1aee52-f1e9-447d-a156-2a25566426e2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-540b86c4-1577-4dbd-b3e3-f686f0f76223 tempest-ServersNegativeTestJSON-2084453743 None] Created volume successfully. Jul 10 19:41:12 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:12 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:13 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.848s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:13 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 1G Jul 10 19:41:13 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:13 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 1G" returned: 0 in 0.927s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:13 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 Jul 10 19:41:13 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Flow 'volume_create_manager' (5edb516c-9951-45f8-8a82-97e9698bdbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e87ae1-c393-470f-a54b-3bb046766933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e87ae1-c393-470f-a54b-3bb046766933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-768207831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3d37c34cc4f7083114e682a8ab216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:14Z,use_quota=True,user_id='a651e860b3924441abe6d163aa319bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fbff02-00d3-41a7-a6be-51a39d40906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fbff02-00d3-41a7-a6be-51a39d40906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0f936f-0343-4e41-ba99-fe3f090280c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0f936f-0343-4e41-ba99-fe3f090280c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee', 'volume_name': 'volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49247c90-5ade-4795-95ff-d39e038e5c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49247c90-5ade-4795-95ff-d39e038e5c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1139fa-2a6f-41fb-890b-3a6e6b45727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Volume 1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee', 'volume_size': 1} Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:14 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75" returned: 0 in 0.753s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:14 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 is being set with open permissions: ugo+rw Jul 10 19:41:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:14 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 Jul 10 19:41:14 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:15 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75" returned: 0 in 0.657s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.923s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Creating offline snapshot 251020ce-d8aa-47ca-a304-64ed9ec4ca79 of volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:41:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b84a0763-733f-4b67-a538-11794ab1959d tempest-VolumesDeleteCascade-1834376857 None] Create snapshot completed successfully Jul 10 19:41:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cee4c64-cc20-402c-aff5-abb3ba4ecd24]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:15 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:15 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:16 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:16 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 1G Jul 10 19:41:16 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Performing cascade delete. {{(pid=87164) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-02d229c2-3041-4e7a-aa95-f5a09e1d3a75-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-02d229c2-3041-4e7a-aa95-f5a09e1d3a75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-02d229c2-3041-4e7a-aa95-f5a09e1d3a75" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-02d229c2-3041-4e7a-aa95-f5a09e1d3a75" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Deleting offline snapshot 02d229c2-3041-4e7a-aa95-f5a09e1d3a75 of volume 4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] snapshot_file for this snap is: volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95d5cd7-29da-4ab9-ab72-807a0b8ef6a9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:16 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 Jul 10 19:41:16 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:17 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 1G" returned: 0 in 0.950s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:17 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 Jul 10 19:41:17 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:17 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75" returned: 0 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ec2d0-d2e6-4cad-bb5a-69591769af5b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:17 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:17 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Acquiring lock "cinder-e22cdc1f-8207-43e0-800a-46f9cabef98e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "cinder-e22cdc1f-8207-43e0-800a-46f9cabef98e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Acquiring lock "cinder-quobyte-e22cdc1f-8207-43e0-800a-46f9cabef98e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "cinder-quobyte-e22cdc1f-8207-43e0-800a-46f9cabef98e" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8dc1c1-0760-4d7c-8cad-e3bb8914ac84]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:18 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:18 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 is being set with open permissions: ugo+rw Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:18 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e Jul 10 19:41:18 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:18 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 Jul 10 19:41:18 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:18 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.852s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:18 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 Jul 10 19:41:18 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:18 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79" returned: 0 in 0.702s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:18 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.344s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.381s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-768207831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3d37c34cc4f7083114e682a8ab216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:14Z,use_quota=True,user_id='a651e860b3924441abe6d163aa319bf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Creating volume 1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:41:18 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e" returned: 0 in 0.894s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:18 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee 1073741824 Jul 10 19:41:18 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e0cdfe0e-cafa-451e-949a-f6517f4a76ea tempest-VolumesSnapshotListTestJSON-246840896 None] Create snapshot completed successfully Jul 10 19:41:18 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e Jul 10 19:41:18 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:19 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75" returned: 0 in 0.861s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:19 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75 Jul 10 19:41:19 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:19 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e22cdc1f-8207-43e0-800a-46f9cabef98e" returned: 0 in 0.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "cinder-quobyte-e22cdc1f-8207-43e0-800a-46f9cabef98e" released by "delete_volume" :: held 1.655s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Created reservations ['2c3abf30-d968-4f94-9e57-cce11f65922e', '2fbe07b9-2799-4720-bfc4-0894bac16ffe', 'bc0678b0-9fd8-4fee-a48e-b65f82ba7f68', 'e0237aaa-2ab1-4545-9407-d0b54d167154'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:19 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:19 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:19 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee 1073741824" returned: 0 in 1.043s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:19 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee Jul 10 19:41:19 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:20 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.02d229c2-3041-4e7a-aa95-f5a09e1d3a75" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-02d229c2-3041-4e7a-aa95-f5a09e1d3a75" released by "_delete_snapshot" :: held 3.502s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" released by "delete_snapshot" :: held 3.527s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Created reservations ['6be58962-59d3-4431-9f01-2983d26e9349', '389c07bb-9960-4120-bc89-11c66c29bbfc', 'd7fefe74-431a-4133-8602-f3c91c8c97c8', '554532e6-e7f0-479c-94f2-6ef75b87034d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:20 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Delete snapshot completed successfully. Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-02d229c2-3041-4e7a-aa95-f5a09e1d3a75-delete_snapshot" released by "delete_snapshot" :: held 3.782s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-031c4a81-41d5-49b4-ac8e-8194f97fa707-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-031c4a81-41d5-49b4-ac8e-8194f97fa707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-031c4a81-41d5-49b4-ac8e-8194f97fa707" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-031c4a81-41d5-49b4-ac8e-8194f97fa707" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Deleting offline snapshot 031c4a81-41d5-49b4-ac8e-8194f97fa707 of volume 4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] snapshot_file for this snap is: volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[91143562-5e86-4242-bf1d-c68f4a3e8bd0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:20 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:20 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Deleted volume successfully. Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cdd3e2e-da22-42eb-b165-07f2ecf576dc tempest-AttachVolumeShelveTestJSON-84275663 None] Lock "cinder-e22cdc1f-8207-43e0-800a-46f9cabef98e-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:20 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:20 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-251020ce-d8aa-47ca-a304-64ed9ec4ca79-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-251020ce-d8aa-47ca-a304-64ed9ec4ca79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-251020ce-d8aa-47ca-a304-64ed9ec4ca79" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:20 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee" returned: 0 in 1.045s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1139fa-2a6f-41fb-890b-3a6e6b45727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4adbbf-b5bf-42a8-a785-622972728ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-251020ce-d8aa-47ca-a304-64ed9ec4ca79" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Deleting offline snapshot 251020ce-d8aa-47ca-a304-64ed9ec4ca79 of volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] snapshot_file for this snap is: volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Volume volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee (1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee): created successfully Jul 10 19:41:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4adbbf-b5bf-42a8-a785-622972728ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Flow 'volume_create_manager' (5edb516c-9951-45f8-8a82-97e9698bdbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[201675df-5017-4d47-a0d5-729ed084cc2e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5dcccdeb-6c08-412b-b2ee-709c75dbb1c0 tempest-ServersNegativeTestJSON-2084453743 None] Created volume successfully. Jul 10 19:41:21 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 Jul 10 19:41:21 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:21 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.915s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df552b0-89b6-425f-b1a3-44c702c4327a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:21 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 Jul 10 19:41:21 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:21 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79" returned: 0 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cb7d69-85b3-46cd-b44c-9d3423898058]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:22 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:22 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "cinder-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:22 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" returned: 0 in 1.111s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "cinder-quobyte-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:22 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:22 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-quobyte-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430869e-56cd-4ad2-b379-4657b0e0c38f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:22 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee Jul 10 19:41:22 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:23 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 1.100s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:23 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 Jul 10 19:41:23 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:23 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.980s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:23 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee" returned: 0 in 0.898s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:23 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707 Jul 10 19:41:23 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:23 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee Jul 10 19:41:23 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:24 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79" returned: 0 in 1.077s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:24 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79 Jul 10 19:41:24 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:24 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee" returned: 0 in 0.858s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-quobyte-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee" released by "delete_volume" :: held 1.833s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:24 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08.031c4a81-41d5-49b4-ac8e-8194f97fa707" returned: 0 in 0.957s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-031c4a81-41d5-49b4-ac8e-8194f97fa707" released by "_delete_snapshot" :: held 4.098s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" released by "delete_snapshot" :: held 4.130s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Created reservations ['f6430d9f-88ca-48a7-ab0b-bbf09546145f', 'b301e741-6a1b-4d78-a70c-b823114b8bc9', '98ff9096-2e5b-4ba6-a3fc-b1d40dad9584', 'f57c5bc1-581a-4320-ba4d-1f8f958976d2'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Created reservations ['917034c6-835a-40a0-a8f7-66a388341acd', '4e5876e3-44ff-4d0d-8767-33d43bc5d885', '16e68169-6091-40de-9f8a-22711303609c', 'ea8dc1cb-d909-4101-99a4-b6da2e85022e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:24 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:24 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Delete snapshot completed successfully. Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-031c4a81-41d5-49b4-ac8e-8194f97fa707-delete_snapshot" released by "delete_snapshot" :: held 4.421s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Snapshots deleted, issuing volume delete {{(pid=87164) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "cinder-835c463d-c6b1-4f94-8614-1b1ae43006de-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e5f951-3b91-4fdb-8196-d54eaa9d455e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-835c463d-c6b1-4f94-8614-1b1ae43006de-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "cinder-quobyte-835c463d-c6b1-4f94-8614-1b1ae43006de" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-quobyte-835c463d-c6b1-4f94-8614-1b1ae43006de" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b529e-b2cd-40ca-b538-4fdb42525332]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:25 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.251020ce-d8aa-47ca-a304-64ed9ec4ca79" returned: 0 in 1.034s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:25 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 Jul 10 19:41:25 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-251020ce-d8aa-47ca-a304-64ed9ec4ca79" released by "_delete_snapshot" :: held 4.248s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" released by "delete_snapshot" :: held 4.307s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:25 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de Jul 10 19:41:25 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Created reservations ['1f79fe30-4142-4e90-8a27-9233020fd6cc', '00af03d8-d429-4611-b848-fd218e5ee04e', '21b95961-46c9-441e-b3cb-3cd3cff14151', '5611c7b6-67da-44fd-89e0-960d718186f2'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Delete snapshot completed successfully. Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23668b1f-d60d-4e87-9778-67b5890f658f tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-251020ce-d8aa-47ca-a304-64ed9ec4ca79-delete_snapshot" released by "delete_snapshot" :: held 4.632s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:25 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.959s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Deleted volume successfully. Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7eab60ba-6063-46e4-b79d-c4b82575d439 tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-1d6abdf4-d1db-4a32-a780-ec0d47a3a0ee-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" returned: 0 in 1.045s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:25 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:26 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08 Jul 10 19:41:26 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:26 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de" returned: 0 in 1.065s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-42c24925-2613-4cd5-9fe5-613793a8f0a3-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:26 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de Jul 10 19:41:26 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-42c24925-2613-4cd5-9fe5-613793a8f0a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-42c24925-2613-4cd5-9fe5-613793a8f0a3" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-42c24925-2613-4cd5-9fe5-613793a8f0a3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Deleting offline snapshot 42c24925-2613-4cd5-9fe5-613793a8f0a3 of volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] snapshot_file for this snap is: volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c257a-82d5-45e4-8947-c01256962233]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:26 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:26 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:26 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" returned: 0 in 0.814s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08" released by "delete_volume" :: held 1.988s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Created reservations ['65540ec7-2d9d-418f-9044-39a47e116b77', '73e1d7a7-e383-4d41-aae6-97663e6c2c66', '653cc48c-ddea-4b9c-a0a3-5f88d2292552', '48fc2603-5058-4269-9c5b-626ed11f8716'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:27 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:27 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:27 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-835c463d-c6b1-4f94-8614-1b1ae43006de" returned: 0 in 0.879s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-quobyte-835c463d-c6b1-4f94-8614-1b1ae43006de" released by "delete_volume" :: held 2.025s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Created reservations ['228686f1-34fe-4b48-83a9-f12353986249', '225390c5-343b-4380-afbc-b4946f4e89b3', '03a761e8-c4f9-41fc-a432-e99ae193ece3', 'bf77b354-5e8e-4103-bc23-36e9b06a59e0'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:27 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 0.942s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:27 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:27 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acfa4da-0990-4e81-84bc-1f49caa06fee]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:27 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:41:27 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:27 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.881s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Deleted volume successfully. Jul 10 19:41:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-77621fac-a519-4d2d-861c-1f2ecdf3b8ae tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-4ab7d4aa-a5cb-4ac9-b052-54e6b4551c08-delete_volume" released by "delete_volume" :: held 11.433s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:28 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.943s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Deleted volume successfully. Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-60d65c09-c3ce-4453-8f17-ac82d7f60ddf tempest-ServersNegativeTestJSON-2084453743 None] Lock "cinder-835c463d-c6b1-4f94-8614-1b1ae43006de-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:28 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 1.047s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:28 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:28 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Flow 'volume_create_manager' (96ff8f8e-a8c9-4d0d-9dfe-0984f25fb01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a19b28f-498a-4d3e-b6c1-e7da61404d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a19b28f-498a-4d3e-b6c1-e7da61404d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1014839343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dde91f6-bb7a-47e8-aedb-2a3eb971127f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021d7da71f24343b2099f0e6698589a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:28Z,use_quota=True,user_id='32539ca9d27c4e89bd22486d5bbb79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb499bf-e131-4c3e-8887-afff6f3d1125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb499bf-e131-4c3e-8887-afff6f3d1125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f403dce6-b638-4219-b08a-315dabe29dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f403dce6-b638-4219-b08a-315dabe29dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dde91f6-bb7a-47e8-aedb-2a3eb971127f', 'volume_name': 'volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4392c4b-342c-444d-9c1b-cd3c3da68de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4392c4b-342c-444d-9c1b-cd3c3da68de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce41f62-9762-41b2-b193-ee70eaed5d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:28 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Volume 3dde91f6-bb7a-47e8-aedb-2a3eb971127f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f', 'volume_size': 1} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1014839343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dde91f6-bb7a-47e8-aedb-2a3eb971127f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021d7da71f24343b2099f0e6698589a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:28Z,use_quota=True,user_id='32539ca9d27c4e89bd22486d5bbb79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Creating volume 3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:41:28 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:41:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:28 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f 1073741824 Jul 10 19:41:28 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:29 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 0.880s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:29 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3 Jul 10 19:41:29 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:29 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f 1073741824" returned: 0 in 0.972s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:29 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:29 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:29 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.42c24925-2613-4cd5-9fe5-613793a8f0a3" returned: 0 in 0.699s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-42c24925-2613-4cd5-9fe5-613793a8f0a3" released by "_delete_snapshot" :: held 3.739s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" released by "delete_snapshot" :: held 3.775s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Created reservations ['ec11d2c0-110b-4d49-88b7-551eb293b523', '14127474-04a0-46c7-96ca-858fe0a5f81b', '350a2a48-6c08-4fcf-94b2-1ffeeb89ad4c', '4b98fb31-4d34-4e17-9235-2477f2202666'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Delete snapshot completed successfully. Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f4afa07e-cdf4-428c-be84-cc9111c969be tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-42c24925-2613-4cd5-9fe5-613793a8f0a3-delete_snapshot" released by "delete_snapshot" :: held 3.938s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:30 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 0.924s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce41f62-9762-41b2-b193-ee70eaed5d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5324a9-2f02-4aa5-b1da-be4347033fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-3881324a-8acc-43b7-a5fb-7b32251c2bc6-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:30 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Volume volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f (3dde91f6-bb7a-47e8-aedb-2a3eb971127f): created successfully Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5324a9-2f02-4aa5-b1da-be4347033fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Flow 'volume_create_manager' (96ff8f8e-a8c9-4d0d-9dfe-0984f25fb01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-3881324a-8acc-43b7-a5fb-7b32251c2bc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-017fc884-f738-42a6-be56-8b9a3cf9eb09 tempest-VolumesDeleteCascade-1834376857 None] Created volume successfully. Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-3881324a-8acc-43b7-a5fb-7b32251c2bc6" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-3881324a-8acc-43b7-a5fb-7b32251c2bc6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Deleting offline snapshot 3881324a-8acc-43b7-a5fb-7b32251c2bc6 of volume cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] snapshot_file for this snap is: volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6030cba7-2472-4e81-9bba-723d69c62aae]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:30 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:41:30 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:31 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 0.961s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[66913246-2de7-4b82-b3e9-e7df6457fec8]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:31 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 Jul 10 19:41:31 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Creating offline snapshot 5349dc57-de73-455e-8dd4-eeac42452288 of volume 3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[af032bc8-9755-43b6-92ee-5e2b5b89a67f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:32 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:32 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:32 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" returned: 0 in 0.941s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:32 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:41:32 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:32 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 0.879s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:32 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 1G Jul 10 19:41:32 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:33 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 0.798s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:33 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6 Jul 10 19:41:33 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:33 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 1G" returned: 0 in 0.882s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:33 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 Jul 10 19:41:33 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:34 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5.3881324a-8acc-43b7-a5fb-7b32251c2bc6" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-3881324a-8acc-43b7-a5fb-7b32251c2bc6" released by "_delete_snapshot" :: held 3.523s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" released by "delete_snapshot" :: held 3.545s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Created reservations ['3dc04bca-c685-4155-8c0b-8113c629332c', '97936e3a-8dec-4a9f-9169-d90832530ddf', '9878521f-f4de-4aa4-8ef2-6506651ad3d3', '469e0828-7a52-4c7f-82b1-be151d3658fd'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Delete snapshot completed successfully. Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f163efab-5919-4cdb-9a69-eacfb84f7fc4 tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-3881324a-8acc-43b7-a5fb-7b32251c2bc6-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:34 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288" returned: 0 in 0.718s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:34 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 is being set with open permissions: ugo+rw Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:34 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 Jul 10 19:41:34 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1211359c-b509-4d0a-8245-8fa091173663 tempest-BackendsCapabilitiesAdminTestsJSON-1101772824 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7570419311523, 'free_capacity_gb': 1775.7570419311523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87164) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-cbba63d9-07b5-43fc-9ff1-2db61213e2b5-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-cbba63d9-07b5-43fc-9ff1-2db61213e2b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee6269-8d99-4a67-84b4-a402c9c5c1c4]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:35 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:35 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 Jul 10 19:41:35 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f6cdf8a1-8859-46c6-bacc-5f39491f63b9 tempest-BackendsCapabilitiesAdminTestsJSON-1101772824 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7570419311523, 'free_capacity_gb': 1775.7570419311523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87164) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 19:41:35 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info Jul 10 19:41:35 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:35 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:35 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info" returned: 0 in 0.658s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:35 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info is being set with open permissions: ugo+rw Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:35 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info Jul 10 19:41:35 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:35 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5 Jul 10 19:41:35 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:36 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.info" returned: 0 in 0.744s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.681s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:36 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-quobyte-cbba63d9-07b5-43fc-9ff1-2db61213e2b5" released by "delete_volume" :: held 1.662s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2ec5dac4-d988-47dc-b8e0-269b88f9dc92 tempest-VolumesDeleteCascade-1834376857 None] Create snapshot completed successfully Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Created reservations ['ab2f5d62-71c7-4cc8-8e7d-dff2eaad859d', '7de5cbb8-f388-4d45-b8cb-70c16121730c', '80093e50-17c2-4c78-a916-bc962a323b29', 'a661c962-92d5-42d4-a54a-118eb667be07'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:36 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:36 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:37 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:37 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:37 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.023s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Deleted volume successfully. Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7079a422-8c36-435a-8662-cc835383a0af tempest-VolumesSnapshotListTestJSON-246840896 None] Lock "cinder-cbba63d9-07b5-43fc-9ff1-2db61213e2b5-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Flow 'volume_create_manager' (fae9d1ab-ee7f-4450-95f0-c639f59f474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d922c4-25fb-4749-b2be-b68a48ec3cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d922c4-25fb-4749-b2be-b68a48ec3cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1309843371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7ccf18-635e-42be-a290-8b017e2c610b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c021d7da71f24343b2099f0e6698589a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5349dc57-de73-455e-8dd4-eeac42452288,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:38Z,use_quota=True,user_id='32539ca9d27c4e89bd22486d5bbb79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e1ed81-ac12-476b-a4a6-6c230ed8e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e1ed81-ac12-476b-a4a6-6c230ed8e010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99932d5-a414-47bc-bae4-d464db0147fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99932d5-a414-47bc-bae4-d464db0147fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e7ccf18-635e-42be-a290-8b017e2c610b', 'volume_name': 'volume-4e7ccf18-635e-42be-a290-8b017e2c610b', 'volume_size': 1, 'snapshot_id': '5349dc57-de73-455e-8dd4-eeac42452288'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcc95ee-6924-41b9-990f-3aa150bddce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcc95ee-6924-41b9-990f-3aa150bddce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f1eac-a7be-420e-b4e4-75092ff504b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:38 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Volume 4e7ccf18-635e-42be-a290-8b017e2c610b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e7ccf18-635e-42be-a290-8b017e2c610b', 'volume_size': 1, 'snapshot_id': '5349dc57-de73-455e-8dd4-eeac42452288'} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-5349dc57-de73-455e-8dd4-eeac42452288-4e7ccf18-635e-42be-a290-8b017e2c610b" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-5349dc57-de73-455e-8dd4-eeac42452288-4e7ccf18-635e-42be-a290-8b017e2c610b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Creating volume 4e7ccf18-635e-42be-a290-8b017e2c610b from snapshot 5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-4e7ccf18-635e-42be-a290-8b017e2c610b" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4e7ccf18-635e-42be-a290-8b017e2c610b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] snapshot: 5349dc57-de73-455e-8dd4-eeac42452288, volume: 4e7ccf18-635e-42be-a290-8b017e2c610b, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6555fe49-fa7e-44ee-a567-a7c8d4562863]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:38 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 Jul 10 19:41:38 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:38 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.931s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:41:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:41:39 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288" returned: 0 in 0.946s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:41:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:41:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f37060-4eb0-46ad-8c61-99eef461913c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:39 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:39 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:40 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 1.128s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:40 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:41:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:40 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b Jul 10 19:41:40 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Flow 'volume_create_manager' (1e35abd7-9206-4c6e-93c8-8d64ee79d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d479ced-2c1e-4ffe-aff1-998d81a05b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d479ced-2c1e-4ffe-aff1-998d81a05b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-308571296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503a7f9e-1f9f-46db-b6b2-044e1592ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966844e2caf64a1392ed87f8a8b42691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:42Z,use_quota=True,user_id='988f5a2ae9a24465b7c0d60ad105c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca75b39-216e-4f7b-ae2f-d7a0b9dae6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca75b39-216e-4f7b-ae2f-d7a0b9dae6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ac2c5f-92a7-4025-9e91-3e8e61ef3309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ac2c5f-92a7-4025-9e91-3e8e61ef3309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503a7f9e-1f9f-46db-b6b2-044e1592ec3d', 'volume_name': 'volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d', 'volume_size': 2}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498bc6e8-184b-4342-91e4-627937eecc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498bc6e8-184b-4342-91e4-627937eecc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811d2ecf-f36a-40f9-9c0a-8fdcc055bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:42 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Volume 503a7f9e-1f9f-46db-b6b2-044e1592ec3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d', 'volume_size': 2} Jul 10 19:41:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:46 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b" returned: 0 in 6.440s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:46 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0710606-21ee-49e1-8792-d0080f7f7cf3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:46 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:46 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:47 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 1.091s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:47 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:41:47 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Converted 1024.00 MB image at 158.98 MB/s Jul 10 19:41:47 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b is being set with open permissions: ugo+rw Jul 10 19:41:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:47 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b Jul 10 19:41:47 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:48 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b" returned: 0 in 0.743s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4e7ccf18-635e-42be-a290-8b017e2c610b" released by "_copy_volume_from_snapshot" :: held 10.497s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-5349dc57-de73-455e-8dd4-eeac42452288-4e7ccf18-635e-42be-a290-8b017e2c610b" released by "_create_volume_from_snapshot" :: held 10.542s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.567s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.175s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-308571296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503a7f9e-1f9f-46db-b6b2-044e1592ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966844e2caf64a1392ed87f8a8b42691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:41:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:41:42Z,use_quota=True,user_id='988f5a2ae9a24465b7c0d60ad105c7de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Creating volume 503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:41:48 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d 2147483648 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:48 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d 2147483648 Jul 10 19:41:48 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f1eac-a7be-420e-b4e4-75092ff504b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7ccf18-635e-42be-a290-8b017e2c610b', 'volume_size': 1, 'snapshot_id': '5349dc57-de73-455e-8dd4-eeac42452288'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397a0936-e1ed-49f0-8cc2-986b6ec393bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:48 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Volume volume-4e7ccf18-635e-42be-a290-8b017e2c610b (4e7ccf18-635e-42be-a290-8b017e2c610b): created successfully Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397a0936-e1ed-49f0-8cc2-986b6ec393bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Flow 'volume_create_manager' (fae9d1ab-ee7f-4450-95f0-c639f59f474f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ef358897-776d-4b74-9b43-0e344798685e tempest-VolumesDeleteCascade-1834376857 None] Created volume successfully. Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-3dde91f6-bb7a-47e8-aedb-2a3eb971127f-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-3dde91f6-bb7a-47e8-aedb-2a3eb971127f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Performing cascade delete. {{(pid=87164) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-5349dc57-de73-455e-8dd4-eeac42452288-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-5349dc57-de73-455e-8dd4-eeac42452288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-5349dc57-de73-455e-8dd4-eeac42452288" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-5349dc57-de73-455e-8dd4-eeac42452288" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Deleting offline snapshot 5349dc57-de73-455e-8dd4-eeac42452288 of volume 3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] snapshot_file for this snap is: volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fab068-3c1f-4132-bcee-18dd74888eaa]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:49 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 Jul 10 19:41:49 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:49 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d 2147483648" returned: 0 in 1.148s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:49 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d Jul 10 19:41:49 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:50 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288" returned: 0 in 1.029s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b7df0d-26bb-433b-a3e5-42a62fc7fc75]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:50 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:50 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:50 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" returned: 0 in 0.924s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811d2ecf-f36a-40f9-9c0a-8fdcc055bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d', 'volume_size': 2}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2b8449-2127-4285-be62-23967897f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:41:50 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Volume volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d (503a7f9e-1f9f-46db-b6b2-044e1592ec3d): created successfully Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2b8449-2127-4285-be62-23967897f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:41:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Flow 'volume_create_manager' (1e35abd7-9206-4c6e-93c8-8d64ee79d796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:41:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-aaa8d23f-dc58-4e12-8f57-4b0566dacfbf tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Created volume successfully. Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Creating offline snapshot 75bc7982-219e-4a61-8eb2-915c807eb545 of volume 503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb916a40-0807-459b-9661-f7fcaf65be5b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:51 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 1.003s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:51 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 Jul 10 19:41:51 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:51 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d Jul 10 19:41:51 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:52 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288" returned: 0 in 1.138s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:52 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" returned: 0 in 1.186s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 2G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:52 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288 Jul 10 19:41:52 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:52 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 2G Jul 10 19:41:52 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:53 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f.5349dc57-de73-455e-8dd4-eeac42452288" returned: 0 in 0.926s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-5349dc57-de73-455e-8dd4-eeac42452288" released by "_delete_snapshot" :: held 4.255s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" released by "delete_snapshot" :: held 4.295s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Created reservations ['d3356030-9dd9-49b6-90b2-f3510874ffea', 'adc5f038-77d4-4e60-8cc8-c26ee1e6c8b7', '667aa75c-f329-4ace-bdb0-06dc9fe42be7', '3beae877-c255-4c49-a996-3ac56e50792a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:53 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 2G" returned: 0 in 1.096s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:53 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 Jul 10 19:41:53 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:53 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Delete snapshot completed successfully. Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-5349dc57-de73-455e-8dd4-eeac42452288-delete_snapshot" released by "delete_snapshot" :: held 4.522s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Snapshots deleted, issuing volume delete {{(pid=87164) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315ea66-c333-47c5-9678-d6e7e24e153c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:53 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:53 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:54 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545" returned: 0 in 0.935s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:54 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 is being set with open permissions: ugo+rw Jul 10 19:41:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:54 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 Jul 10 19:41:54 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:54 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 0.968s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:54 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f Jul 10 19:41:54 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:55 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545" returned: 0 in 0.981s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:55 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info Jul 10 19:41:55 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:55 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" returned: 0 in 0.918s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-3dde91f6-bb7a-47e8-aedb-2a3eb971127f" released by "delete_volume" :: held 1.991s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Created reservations ['f20747f3-54b0-4dc9-b9ee-6132da65d70e', 'e89a6976-0d3b-4fd0-9b29-e2dc6f8b94c9', '4db811cc-2414-4eee-a8c8-1dd2e8042322', '4da21b81-1b6a-4b70-b53e-4fdcfae93ec3'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:55 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:55 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:56 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info" returned: 0 in 0.787s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:56 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info is being set with open permissions: ugo+rw Jul 10 19:41:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:56 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info Jul 10 19:41:56 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:56 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:56 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:41:56 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Deleted volume successfully. Jul 10 19:41:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b34a0e8f-d102-488c-b7ef-670f35078ab6 tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-3dde91f6-bb7a-47e8-aedb-2a3eb971127f-delete_volume" released by "delete_volume" :: held 7.565s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-4e7ccf18-635e-42be-a290-8b017e2c610b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-4e7ccf18-635e-42be-a290-8b017e2c610b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "cinder-quobyte-4e7ccf18-635e-42be-a290-8b017e2c610b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4e7ccf18-635e-42be-a290-8b017e2c610b" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517426b-d2d7-49b3-9861-4c895b4da193]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:57 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b Jul 10 19:41:57 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:57 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.info" returned: 0 in 0.971s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.138s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-07cf00a9-5ab8-44f4-9e4c-e44ab0025fc4 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Create snapshot completed successfully Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "cinder-75bc7982-219e-4a61-8eb2-915c807eb545-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-75bc7982-219e-4a61-8eb2-915c807eb545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "cinder-quobyte-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-quobyte-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "cinder-quobyte-75bc7982-219e-4a61-8eb2-915c807eb545" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-quobyte-75bc7982-219e-4a61-8eb2-915c807eb545" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Deleting offline snapshot 75bc7982-219e-4a61-8eb2-915c807eb545 of volume 503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] snapshot_file for this snap is: volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5acb69-46f9-4452-801c-7f69673f6469]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:58 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 Jul 10 19:41:58 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:58 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b" returned: 0 in 0.898s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:58 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b Jul 10 19:41:58 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:58 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545" returned: 0 in 0.906s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a02e9f-5baa-4d3c-a5c0-c6fceeeec36c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:58 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4e7ccf18-635e-42be-a290-8b017e2c610b" returned: 0 in 0.830s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:58 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d Jul 10 19:41:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-quobyte-4e7ccf18-635e-42be-a290-8b017e2c610b" released by "delete_volume" :: held 1.793s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:41:58 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Created reservations ['eaa1c5ac-a81b-4098-a2b3-4eb1dc79dbde', '0a32ebbb-d35c-4d92-a91f-da506b7861be', '286ca12b-9caf-446f-b544-4ac272a15892', 'ee4b1bef-92fa-462d-b9c4-9d9560d9a97d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:59 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:41:59 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:41:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d7f6d030-2275-490f-912c-2d5fc677ae2b tempest-GroupsTest-1227344730 None] Group tempest-Group1-2019662546: creating Jul 10 19:41:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d7f6d030-2275-490f-912c-2d5fc677ae2b tempest-GroupsTest-1227344730 None] Group tempest-Group1-2019662546: created successfully Jul 10 19:41:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d7f6d030-2275-490f-912c-2d5fc677ae2b tempest-GroupsTest-1227344730 None] Create group completed successfully. Jul 10 19:41:59 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" returned: 0 in 0.984s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:41:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:41:59 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 Jul 10 19:41:59 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:00 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.835s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:00 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Deleted volume successfully. Jul 10 19:42:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d08d6453-3a1f-413b-9e9d-95f1b2c913de tempest-VolumesDeleteCascade-1834376857 None] Lock "cinder-4e7ccf18-635e-42be-a290-8b017e2c610b-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8d615b71-cbda-4fa6-9b4e-dcb5ea73ff86 tempest-GroupsTest-1227344730 None] Group tempest-Group2-1413166033: creating Jul 10 19:42:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8d615b71-cbda-4fa6-9b4e-dcb5ea73ff86 tempest-GroupsTest-1227344730 None] Group tempest-Group2-1413166033: created successfully Jul 10 19:42:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8d615b71-cbda-4fa6-9b4e-dcb5ea73ff86 tempest-GroupsTest-1227344730 None] Create group completed successfully. Jul 10 19:42:00 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545" returned: 0 in 0.951s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:00 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545 Jul 10 19:42:00 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:01 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d.75bc7982-219e-4a61-8eb2-915c807eb545" returned: 0 in 0.768s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-quobyte-75bc7982-219e-4a61-8eb2-915c807eb545" released by "_delete_snapshot" :: held 3.761s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-quobyte-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" released by "delete_snapshot" :: held 3.792s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:01 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Created reservations ['759f683b-b71b-4be1-98f0-6966cb558e87', 'baf62a06-588a-4ea6-89dc-711ae4e7d73c', '5fca3bd6-d2d2-4350-acfc-b59464fac6e2', '35b0eff7-33de-4cc2-b553-21b4c645b921'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Delete snapshot completed successfully. Jul 10 19:42:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12100ec7-9bce-42a9-a4e8-d6d6641d4d33 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-75bc7982-219e-4a61-8eb2-915c807eb545-delete_snapshot" released by "delete_snapshot" :: held 3.967s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "cinder-503a7f9e-1f9f-46db-b6b2-044e1592ec3d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-503a7f9e-1f9f-46db-b6b2-044e1592ec3d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "cinder-quobyte-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-quobyte-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b671962-e975-4891-b622-89b51596616e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:02 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d Jul 10 19:42:02 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Flow 'volume_create_manager' (964fc659-4099-412d-83f8-1716bf242c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2076277-8f52-482d-aca6-a26ad05618e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2076277-8f52-482d-aca6-a26ad05618e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046516899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=554492b2-b664-4a5a-9d2a-95179d8e702d,host='devstack@QuobyteHD#QuobyteHD',id=4d0708b0-c6db-44aa-8720-1aa32a1d6e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a963d062026146dab3a4ac377cbb86d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:03Z,use_quota=True,user_id='917a759364744a37b05c49f2456f2a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a1c2f76-e659-46af-b27e-35d767cfe18b),volume_type_id=2a1c2f76-e659-46af-b27e-35d767cfe18b)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac15fd70-eb03-4e5a-b626-7174a97dbd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac15fd70-eb03-4e5a-b626-7174a97dbd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c26ea7-7d75-4637-89b0-1a213dda365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c26ea7-7d75-4637-89b0-1a213dda365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0708b0-c6db-44aa-8720-1aa32a1d6e7d', 'volume_name': 'volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a60d3c-ca73-4499-8b49-ec3ab8c860ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a60d3c-ca73-4499-8b49-ec3ab8c860ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b43f9f-513c-4d9e-9866-a66b2dab15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:02 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Volume 4d0708b0-c6db-44aa-8720-1aa32a1d6e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d', 'volume_size': 1} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=554492b2-b664-4a5a-9d2a-95179d8e702d,created_at=2026-07-10T17:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046516899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=554492b2-b664-4a5a-9d2a-95179d8e702d,host='devstack@QuobyteHD#QuobyteHD',id=4d0708b0-c6db-44aa-8720-1aa32a1d6e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a963d062026146dab3a4ac377cbb86d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:03Z,use_quota=True,user_id='917a759364744a37b05c49f2456f2a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a1c2f76-e659-46af-b27e-35d767cfe18b),volume_type_id=2a1c2f76-e659-46af-b27e-35d767cfe18b)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Creating volume 4d0708b0-c6db-44aa-8720-1aa32a1d6e7d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:02 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:02 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d 1073741824 Jul 10 19:42:02 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:03 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" returned: 0 in 0.893s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:03 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d Jul 10 19:42:03 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:03 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d 1073741824" returned: 0 in 1.022s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:03 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d Jul 10 19:42:03 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:04 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" returned: 0 in 0.757s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-quobyte-503a7f9e-1f9f-46db-b6b2-044e1592ec3d" released by "delete_volume" :: held 1.747s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Created reservations ['020664d2-3789-44e8-8f46-7cdde86cb2b9', '4d86ba3c-35b3-4c7e-9361-edb66f4d1dff', '758034cb-4741-41d4-8709-d6bb53edff82', '9bebeafb-4e08-4e1b-bb43-82d88a9904a0'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:04 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:04 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:04 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d" returned: 0 in 0.717s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b43f9f-513c-4d9e-9866-a66b2dab15b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54c63c7-eda2-47c6-a165-c34cf4e58985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Volume volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d (4d0708b0-c6db-44aa-8720-1aa32a1d6e7d): created successfully Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54c63c7-eda2-47c6-a165-c34cf4e58985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Flow 'volume_create_manager' (964fc659-4099-412d-83f8-1716bf242c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-90306660-f77f-4352-a701-4d91d9340d71 tempest-GroupsTest-1227344730 None] Created volume successfully. Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Flow 'volume_create_manager' (205a9a00-f253-4739-a602-14ea99dc9624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1f5aef-99ac-44a7-85ce-91ba72baec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1f5aef-99ac-44a7-85ce-91ba72baec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-905214232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5577fa96-578a-40f5-8064-2d5c1de069d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff48d656e8f438ead9b84649255b4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:05Z,use_quota=True,user_id='dc91c81a5b5f466497301dc70c124bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70585eb9-4684-4a4b-8824-18fd9735394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70585eb9-4684-4a4b-8824-18fd9735394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0634d64f-1d81-4624-a318-31b2be442e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0634d64f-1d81-4624-a318-31b2be442e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5577fa96-578a-40f5-8064-2d5c1de069d1', 'volume_name': 'volume-5577fa96-578a-40f5-8064-2d5c1de069d1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9830fba2-eb86-4588-9834-e762186fc6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9830fba2-eb86-4588-9834-e762186fc6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e58f8f-a82f-427f-83d4-e0d68f556a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Volume 5577fa96-578a-40f5-8064-2d5c1de069d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5577fa96-578a-40f5-8064-2d5c1de069d1', 'volume_size': 1} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-905214232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5577fa96-578a-40f5-8064-2d5c1de069d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff48d656e8f438ead9b84649255b4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:05Z,use_quota=True,user_id='dc91c81a5b5f466497301dc70c124bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Creating volume 5577fa96-578a-40f5-8064-2d5c1de069d1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:04 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:04 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 1073741824 Jul 10 19:42:04 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:05 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.932s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Deleted volume successfully. Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59c22c87-6bcb-40fc-be92-ae12c8a770f8 tempest-VolumesSnapshotNegativeTestJSON-117682529 None] Lock "cinder-503a7f9e-1f9f-46db-b6b2-044e1592ec3d-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Acquiring lock "cinder-quobyte-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Lock "cinder-quobyte-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f631dadc-81dc-4ddc-9375-e4b997ebe5d0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:05 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d Jul 10 19:42:05 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:05 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 1073741824" returned: 0 in 1.040s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:06 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 Jul 10 19:42:06 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:06 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:06 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d" returned: 0 in 0.902s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e58f8f-a82f-427f-83d4-e0d68f556a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5577fa96-578a-40f5-8064-2d5c1de069d1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:06 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d Jul 10 19:42:06 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e45673-32c1-41c5-93b6-f1e1649cf619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:06 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Volume volume-5577fa96-578a-40f5-8064-2d5c1de069d1 (5577fa96-578a-40f5-8064-2d5c1de069d1): created successfully Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e45673-32c1-41c5-93b6-f1e1649cf619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Flow 'volume_create_manager' (205a9a00-f253-4739-a602-14ea99dc9624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5627918f-e24b-4f4f-b5e9-af535addd3d1 tempest-VolumesTransfersTest-1553641537 None] Created volume successfully. Jul 10 19:42:07 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d" returned: 0 in 0.879s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Lock "cinder-quobyte-4d0708b0-c6db-44aa-8720-1aa32a1d6e7d" released by "delete_volume" :: held 1.839s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Created reservations ['ae6e362a-3e66-4b88-ba86-825f41a38e27'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:07 devstack cinder-volume[87164]: WARNING cinder.quota [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1012842309 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1012842309, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:42:07 devstack cinder-volume[87164]: WARNING cinder.quota [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1012842309 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1012842309, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Created reservations ['9f858d71-14f5-452f-905c-4a14e2e7e0d8', '508f8117-2734-455c-a60f-c12435394ea1', '51e7f928-5c64-4d13-9c1e-49b2e049752e', '6bce2d75-4c44-49e2-8a51-bb41ed3d4686'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:07 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:07 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d5ffac9d-49ca-4ac8-89cb-b48d395c3594 tempest-VolumesTransfersTest-711465687 None] Transfer volume completed successfully. Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=140,cinder:SELECT=114,cinder:DELETE=11,cinder:INSERT=39 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=117,cinder:DELETE=9,cinder:UPDATE=140,cinder:INSERT=34 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Created reservations ['3af4e6e9-eafc-4d50-adbc-72d6de380e88'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:08 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:08 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:08 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.088s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:08 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5772bc61-329c-41a6-b88c-2f54d340a652 tempest-GroupsTest-1227344730 None] Delete group completed successfully. Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Acquiring lock "cinder-5577fa96-578a-40f5-8064-2d5c1de069d1-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-5577fa96-578a-40f5-8064-2d5c1de069d1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Acquiring lock "cinder-quobyte-5577fa96-578a-40f5-8064-2d5c1de069d1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-quobyte-5577fa96-578a-40f5-8064-2d5c1de069d1" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d24ee5a-4b8b-4b11-bbdd-ea6ccccee3b1]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:09 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.281s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:09 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ff7f648b-a60f-4064-b1c3-a0c85bd8515b tempest-GroupsTest-1227344730 None] Delete group completed successfully. Jul 10 19:42:09 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 Jul 10 19:42:09 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d4898b3b-099e-4a31-a52f-95bca94df5a2 tempest-GroupsTest-1227344730 None] Group tempest-GroupsTest-Group-1723024567: creating Jul 10 19:42:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d4898b3b-099e-4a31-a52f-95bca94df5a2 tempest-GroupsTest-1227344730 None] Group tempest-GroupsTest-Group-1723024567: created successfully Jul 10 19:42:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d4898b3b-099e-4a31-a52f-95bca94df5a2 tempest-GroupsTest-1227344730 None] Create group completed successfully. Jul 10 19:42:10 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1" returned: 0 in 0.957s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:10 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1 Jul 10 19:42:10 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:11 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5577fa96-578a-40f5-8064-2d5c1de069d1" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-quobyte-5577fa96-578a-40f5-8064-2d5c1de069d1" released by "delete_volume" :: held 1.730s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Created reservations ['86445704-5dff-4510-8870-f4186bc1d931', '7a45144c-a3ad-4281-bd75-a8d64d5d5d53', '56be6735-7db7-4066-800a-4fa4b34f13fb', 'b103ef8b-8671-460d-a862-f635c7594584'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:11 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:11 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Flow 'volume_create_manager' (6360efdc-6b3a-4458-9415-1afcd98cbe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e04c97-3602-4b84-b19d-502d8e9b185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e04c97-3602-4b84-b19d-502d8e9b185e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596358464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b939fe7-f709-42da-be5b-4bd321c572c1,host='devstack@QuobyteHD#QuobyteHD',id=0fd8f3e0-9934-4868-a423-1d47c0cea346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a963d062026146dab3a4ac377cbb86d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:12Z,use_quota=True,user_id='917a759364744a37b05c49f2456f2a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e768afa-0b12-41bc-ad6f-aa188cf36ee4),volume_type_id=0e768afa-0b12-41bc-ad6f-aa188cf36ee4)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32277f17-c569-4edd-a391-934a05f11d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32277f17-c569-4edd-a391-934a05f11d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5797d66e-c3c3-474a-8973-7d8e9b240a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5797d66e-c3c3-474a-8973-7d8e9b240a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd8f3e0-9934-4868-a423-1d47c0cea346', 'volume_name': 'volume-0fd8f3e0-9934-4868-a423-1d47c0cea346', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd9f242-18f1-44df-9c70-b46cc3605068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd9f242-18f1-44df-9c70-b46cc3605068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6021140-c0a1-4b67-9209-8e867e677939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Volume 0fd8f3e0-9934-4868-a423-1d47c0cea346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd8f3e0-9934-4868-a423-1d47c0cea346', 'volume_size': 1} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b939fe7-f709-42da-be5b-4bd321c572c1,created_at=2026-07-10T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596358464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b939fe7-f709-42da-be5b-4bd321c572c1,host='devstack@QuobyteHD#QuobyteHD',id=0fd8f3e0-9934-4868-a423-1d47c0cea346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a963d062026146dab3a4ac377cbb86d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:12Z,use_quota=True,user_id='917a759364744a37b05c49f2456f2a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e768afa-0b12-41bc-ad6f-aa188cf36ee4),volume_type_id=0e768afa-0b12-41bc-ad6f-aa188cf36ee4)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Creating volume 0fd8f3e0-9934-4868-a423-1d47c0cea346 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:12 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:12 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 1073741824 Jul 10 19:42:12 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:12 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.167s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Deleted volume successfully. Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Flow 'volume_create_manager' (cfc74f95-4eda-453c-a33a-0649cf11732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec70551-442b-4dc4-906e-fdbebf569964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8fd4b2a3-1c96-47eb-ac3f-2823c0ae57a9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-5577fa96-578a-40f5-8064-2d5c1de069d1-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec70551-442b-4dc4-906e-fdbebf569964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1594352419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9892bb-310c-4526-b5a0-1e2554c60a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff48d656e8f438ead9b84649255b4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:13Z,use_quota=True,user_id='dc91c81a5b5f466497301dc70c124bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db28c7e-90ef-4a76-ac2a-115510779929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db28c7e-90ef-4a76-ac2a-115510779929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d1a426-97c1-46c6-a9e4-688215a18068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d1a426-97c1-46c6-a9e4-688215a18068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9892bb-310c-4526-b5a0-1e2554c60a0d', 'volume_name': 'volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdde56b-26a6-497d-83da-dd1e115d67ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdde56b-26a6-497d-83da-dd1e115d67ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b301f52-d739-4ca0-9f78-649e3c697bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:12 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Volume 3b9892bb-310c-4526-b5a0-1e2554c60a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d', 'volume_size': 1} Jul 10 19:42:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:13 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 1073741824" returned: 0 in 1.062s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:13 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 Jul 10 19:42:13 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:14 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346" returned: 0 in 1.000s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1594352419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9892bb-310c-4526-b5a0-1e2554c60a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff48d656e8f438ead9b84649255b4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:13Z,use_quota=True,user_id='dc91c81a5b5f466497301dc70c124bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Creating volume 3b9892bb-310c-4526-b5a0-1e2554c60a0d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:14 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:14 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d 1073741824 Jul 10 19:42:14 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6021140-c0a1-4b67-9209-8e867e677939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd8f3e0-9934-4868-a423-1d47c0cea346', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da04690e-9f91-4807-98f2-cadc9dd02c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Volume volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 (0fd8f3e0-9934-4868-a423-1d47c0cea346): created successfully Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da04690e-9f91-4807-98f2-cadc9dd02c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Flow 'volume_create_manager' (6360efdc-6b3a-4458-9415-1afcd98cbe50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2d336644-1e83-4b47-abdf-b970e6690732 tempest-GroupsTest-1227344730 None] Created volume successfully. Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Flow 'volume_create_manager' (6cacfd1c-d491-45ee-a374-817a76ffb008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bfa93e-9d26-4751-a364-07d0e2e33969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bfa93e-9d26-4751-a364-07d0e2e33969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1672161687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b939fe7-f709-42da-be5b-4bd321c572c1,host='devstack@QuobyteHD#QuobyteHD',id=45a78610-7d4b-461d-a4fe-2a7a45befff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a963d062026146dab3a4ac377cbb86d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:16Z,use_quota=True,user_id='917a759364744a37b05c49f2456f2a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e768afa-0b12-41bc-ad6f-aa188cf36ee4),volume_type_id=0e768afa-0b12-41bc-ad6f-aa188cf36ee4)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89cfad7-a6ca-49c9-ba54-56c3922fa490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89cfad7-a6ca-49c9-ba54-56c3922fa490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e03f8f-6714-4f3f-b6bc-236c416c4b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e03f8f-6714-4f3f-b6bc-236c416c4b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a78610-7d4b-461d-a4fe-2a7a45befff1', 'volume_name': 'volume-45a78610-7d4b-461d-a4fe-2a7a45befff1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e10e4a3-4675-4f2a-9cd7-f5a7d5764375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e10e4a3-4675-4f2a-9cd7-f5a7d5764375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7619db9a-6e5c-4d96-ad25-b051dfba502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Volume 45a78610-7d4b-461d-a4fe-2a7a45befff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a78610-7d4b-461d-a4fe-2a7a45befff1', 'volume_size': 1} Jul 10 19:42:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:16 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d 1073741824" returned: 0 in 1.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:16 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d Jul 10 19:42:16 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:17 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d" returned: 0 in 0.889s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b939fe7-f709-42da-be5b-4bd321c572c1,created_at=2026-07-10T17:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1672161687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b939fe7-f709-42da-be5b-4bd321c572c1,host='devstack@QuobyteHD#QuobyteHD',id=45a78610-7d4b-461d-a4fe-2a7a45befff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a963d062026146dab3a4ac377cbb86d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:16Z,use_quota=True,user_id='917a759364744a37b05c49f2456f2a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e768afa-0b12-41bc-ad6f-aa188cf36ee4),volume_type_id=0e768afa-0b12-41bc-ad6f-aa188cf36ee4)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Creating volume 45a78610-7d4b-461d-a4fe-2a7a45befff1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:17 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b301f52-d739-4ca0-9f78-649e3c697bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:17 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 1073741824 Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96542915-f3c7-489c-ba61-00abbe81c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:17 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:17 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Volume volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d (3b9892bb-310c-4526-b5a0-1e2554c60a0d): created successfully Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96542915-f3c7-489c-ba61-00abbe81c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Flow 'volume_create_manager' (cfc74f95-4eda-453c-a33a-0649cf11732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7deb4951-7aef-42bb-8cb4-9b4631e8c3aa tempest-VolumesTransfersTest-1553641537 None] Created volume successfully. Jul 10 19:42:18 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 1073741824" returned: 0 in 1.795s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:19 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 Jul 10 19:42:19 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Acquiring lock "cinder-3b9892bb-310c-4526-b5a0-1e2554c60a0d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-3b9892bb-310c-4526-b5a0-1e2554c60a0d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Acquiring lock "cinder-quobyte-3b9892bb-310c-4526-b5a0-1e2554c60a0d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-quobyte-3b9892bb-310c-4526-b5a0-1e2554c60a0d" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dfed69-32b1-4cc5-b1d5-6c0dfa0f0fa9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:19 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d Jul 10 19:42:19 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:20 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1" returned: 0 in 1.585s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] <== create_volume: return (3495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.502s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7619db9a-6e5c-4d96-ad25-b051dfba502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a78610-7d4b-461d-a4fe-2a7a45befff1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8d244a-5624-4b26-9472-3bd40261d348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Volume volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 (45a78610-7d4b-461d-a4fe-2a7a45befff1): created successfully Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8d244a-5624-4b26-9472-3bd40261d348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Flow 'volume_create_manager' (6cacfd1c-d491-45ee-a374-817a76ffb008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:20 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4f0228b3-2601-492b-8c7c-fea426c55978 tempest-GroupsTest-1227344730 None] Created volume successfully. Jul 10 19:42:20 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d" returned: 0 in 1.541s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:20 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d Jul 10 19:42:20 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5b9aa67e-283b-4726-bdb7-982002dabd7c tempest-GroupsTest-1227344730 None] Update group completed successfully. Jul 10 19:42:21 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b9892bb-310c-4526-b5a0-1e2554c60a0d" returned: 0 in 1.046s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-quobyte-3b9892bb-310c-4526-b5a0-1e2554c60a0d" released by "delete_volume" :: held 2.674s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Created reservations ['5b47d4dd-c0cc-4b08-b87e-1d488e6e9476', 'dd4e92db-7e33-4191-a8d5-6f1dacc8d3cc', '2c092303-a946-48ba-8fe3-67825019c4c0', '466846be-7178-4dd2-b8f6-79ed479a4879'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:22 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:22 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:23 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6f619c95-1d54-42c6-93de-d70d05a1dfe1 tempest-GroupsTest-1227344730 None] Update group completed successfully. Jul 10 19:42:23 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.290s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:23 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:23 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Deleted volume successfully. Jul 10 19:42:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8756cb49-96ec-4a22-9859-8cb1454682e9 tempest-VolumesTransfersTest-1796957051 None] Lock "cinder-3b9892bb-310c-4526-b5a0-1e2554c60a0d-delete_volume" released by "delete_volume" :: held 4.411s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Acquiring lock "cinder-quobyte-0fd8f3e0-9934-4868-a423-1d47c0cea346" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Lock "cinder-quobyte-0fd8f3e0-9934-4868-a423-1d47c0cea346" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd515a-ff2f-46cf-a6e3-2ac75033ef3a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:25 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 Jul 10 19:42:25 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:26 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346" returned: 0 in 1.167s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:26 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346 Jul 10 19:42:26 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:27 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0fd8f3e0-9934-4868-a423-1d47c0cea346" returned: 0 in 0.879s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Lock "cinder-quobyte-0fd8f3e0-9934-4868-a423-1d47c0cea346" released by "delete_volume" :: held 2.119s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Acquiring lock "cinder-quobyte-45a78610-7d4b-461d-a4fe-2a7a45befff1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Lock "cinder-quobyte-45a78610-7d4b-461d-a4fe-2a7a45befff1" acquired by "delete_volume" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad18ec3-b80a-4bbd-b4a4-1256f1702cb3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:27 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 Jul 10 19:42:27 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:28 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1" returned: 0 in 1.262s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:28 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1 Jul 10 19:42:28 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:30 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-45a78610-7d4b-461d-a4fe-2a7a45befff1" returned: 0 in 1.339s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Lock "cinder-quobyte-45a78610-7d4b-461d-a4fe-2a7a45befff1" released by "delete_volume" :: held 2.748s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Created reservations ['dd4142ba-e8ef-4bb7-95ca-abc65ff1c812'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:30 devstack cinder-volume[87164]: WARNING cinder.quota [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1115932492 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1115932492, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:42:30 devstack cinder-volume[87164]: WARNING cinder.quota [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1115932492 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1115932492, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Created reservations ['c0764142-68a7-4301-882e-c8ef67efbb50', '6254fe81-4809-4b81-95bf-d32d51c61e45', '0190f485-df3d-4a4d-917f-c7b6e13ebfd1', 'ab9c6bb9-5766-43db-8bb8-e6d5900c2a3e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Created reservations ['146e0527-9aae-40a9-906f-a33afdae9556', '4463d84a-de3b-429e-9cbd-770d38ec6b18', '83c95014-121f-4096-93f1-f1674a0908e5', 'ddf4c404-ca31-4834-ae22-3f8d5c4cb54f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:30 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:30 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:31 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.844s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:31 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-22e5b2c0-6c66-4738-b750-382285a53517 tempest-GroupsTest-1227344730 None] Delete group completed successfully. Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Flow 'volume_create_manager' (08431459-76fb-4258-b3dc-94c5a1fc517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae2967c-7275-40dc-96b9-ec1c2c9e5f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae2967c-7275-40dc-96b9-ec1c2c9e5f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-794491994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855e9aba-a871-4ecb-a91c-75757e56bca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b959a6c5244611a90f3b1c5f4fe058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:34Z,use_quota=True,user_id='24e9588ca58c42d1a6fbee9579cee34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c280caf0-a654-4f1d-a175-bb205d99a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c280caf0-a654-4f1d-a175-bb205d99a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ceca64-802e-4004-aba3-41a3f26492d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ceca64-802e-4004-aba3-41a3f26492d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855e9aba-a871-4ecb-a91c-75757e56bca0', 'volume_name': 'volume-855e9aba-a871-4ecb-a91c-75757e56bca0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543847db-8b33-49ec-8780-597661978126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543847db-8b33-49ec-8780-597661978126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1a9339-d0a4-492c-aa1d-a685cf71e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:34 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Volume 855e9aba-a871-4ecb-a91c-75757e56bca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855e9aba-a871-4ecb-a91c-75757e56bca0', 'volume_size': 1} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-794491994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855e9aba-a871-4ecb-a91c-75757e56bca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b959a6c5244611a90f3b1c5f4fe058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:34Z,use_quota=True,user_id='24e9588ca58c42d1a6fbee9579cee34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Creating volume 855e9aba-a871-4ecb-a91c-75757e56bca0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:34 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:34 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 1073741824 Jul 10 19:42:34 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:35 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 1073741824" returned: 0 in 1.108s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:35 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 Jul 10 19:42:35 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:36 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0" returned: 0 in 0.888s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1a9339-d0a4-492c-aa1d-a685cf71e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855e9aba-a871-4ecb-a91c-75757e56bca0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968ac48d-38c3-421e-bea9-d994add6af1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:36 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Volume volume-855e9aba-a871-4ecb-a91c-75757e56bca0 (855e9aba-a871-4ecb-a91c-75757e56bca0): created successfully Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968ac48d-38c3-421e-bea9-d994add6af1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Flow 'volume_create_manager' (08431459-76fb-4258-b3dc-94c5a1fc517d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-88823615-b01b-4891-b4e9-4eb663b3fbb3 tempest-VolumesTransfersV355Test-1544014128 None] Created volume successfully. Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Flow 'volume_create_manager' (6f256725-1a90-4a65-ba5a-28f60f49fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50310474-7d55-472b-af9a-ba1d3014e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50310474-7d55-472b-af9a-ba1d3014e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-854418202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b400b06b-8f5c-432d-825b-1bbcc0b2363d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07e4a5806094e5eb8c92160c0a596bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:37Z,use_quota=True,user_id='a1d19f41b815498abd0b965fdd4daffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(161f5dfb-5f81-4f32-bb9f-26ab15f8b674),volume_type_id=161f5dfb-5f81-4f32-bb9f-26ab15f8b674)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dca18f8-1783-4f3c-8e15-30aa365bcefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dca18f8-1783-4f3c-8e15-30aa365bcefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789082d9-e2da-4433-bdc5-a91409124002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789082d9-e2da-4433-bdc5-a91409124002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b400b06b-8f5c-432d-825b-1bbcc0b2363d', 'volume_name': 'volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d47b03-74e1-4605-87b4-0a8f8e897dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d47b03-74e1-4605-87b4-0a8f8e897dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b59a83-f39d-4f93-a5fe-51e1e03730d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume b400b06b-8f5c-432d-825b-1bbcc0b2363d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d', 'volume_size': 1} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-854418202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b400b06b-8f5c-432d-825b-1bbcc0b2363d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07e4a5806094e5eb8c92160c0a596bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:37Z,use_quota=True,user_id='a1d19f41b815498abd0b965fdd4daffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(161f5dfb-5f81-4f32-bb9f-26ab15f8b674),volume_type_id=161f5dfb-5f81-4f32-bb9f-26ab15f8b674)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Creating volume b400b06b-8f5c-432d-825b-1bbcc0b2363d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:37 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:37 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d 1073741824 Jul 10 19:42:37 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:37 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:37 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Flow 'volume_create_manager' (8b82ae83-906b-4596-a156-b5693a95cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2be8da8-e6c9-4a6f-8d8f-bf418ad46791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2be8da8-e6c9-4a6f-8d8f-bf418ad46791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-653805775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b603bd3e-46ac-4dcc-9bee-28ba1096dc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07e4a5806094e5eb8c92160c0a596bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:38Z,use_quota=True,user_id='a1d19f41b815498abd0b965fdd4daffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d125c9c-8cd3-424f-a593-6c6626f8a7e1),volume_type_id=6d125c9c-8cd3-424f-a593-6c6626f8a7e1)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6446c63c-db54-4de2-9ca8-46b249c0edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6446c63c-db54-4de2-9ca8-46b249c0edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb9d334-22dd-4eea-a546-55124df6783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb9d334-22dd-4eea-a546-55124df6783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b603bd3e-46ac-4dcc-9bee-28ba1096dc90', 'volume_name': 'volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab916b2-7385-43bb-b785-e1c6a8848a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab916b2-7385-43bb-b785-e1c6a8848a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ca63b-350b-4dfd-a372-097458dc8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:37 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume b603bd3e-46ac-4dcc-9bee-28ba1096dc90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90', 'volume_size': 1} Jul 10 19:42:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:38 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.050s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:42:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0cc9f694-d59a-48a6-89ab-b1528a117bc0 tempest-VolumesTransfersV355Test-185217674 None] Transfer volume completed successfully. Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Flow 'volume_create_manager' (69c18591-fbe6-404f-8425-9b47ecc0c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9da913-7a4c-4a4b-ac71-16a476dafc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9da913-7a4c-4a4b-ac71-16a476dafc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1212729213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07e4a5806094e5eb8c92160c0a596bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:39Z,use_quota=True,user_id='a1d19f41b815498abd0b965fdd4daffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7672fb6b-d640-4d10-bfd7-9a8da431e811),volume_type_id=7672fb6b-d640-4d10-bfd7-9a8da431e811)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d35fe0-e6c8-4a15-be51-d7234d3f92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d35fe0-e6c8-4a15-be51-d7234d3f92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186b3ecd-2cf9-4ae0-bdeb-315a981e22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:42:38 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d 1073741824" returned: 0 in 1.453s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:38 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d Jul 10 19:42:38 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186b3ecd-2cf9-4ae0-bdeb-315a981e22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf', 'volume_name': 'volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf', 'volume_size': 1, 'image_id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--129548025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd07e4a5806094e5eb8c92160c0a596bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'created_at': datetime.datetime(2026, 7, 10, 17, 42, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 42, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5/file', 'properties': {}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3d1aa1-433d-43ae-8712-099fc262452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3d1aa1-433d-43ae-8712-099fc262452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe76c68f-db41-400f-a505-3a04c09366d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf', 'volume_size': 1, 'image_id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--129548025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd07e4a5806094e5eb8c92160c0a596bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'created_at': datetime.datetime(2026, 7, 10, 17, 42, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 42, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5/file', 'properties': {}}, 'image_service': } Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Trying to clone 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf from image 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Flow 'volume_create_manager' (31975d17-3912-4a3f-ae87-2350a28a8714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f0cf04-c25b-472b-95b1-d8c1193c9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f0cf04-c25b-472b-95b1-d8c1193c9a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-887022344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f995fa2e-452c-434b-b3ea-580d0d985462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20856b41537b4a93bd49a8d091c5b2bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:39Z,use_quota=True,user_id='330bfd296ae64d9db1b8a4316ee124b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a948596-808e-43c9-8fd0-c6df651afa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a948596-808e-43c9-8fd0-c6df651afa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787088fe-352d-4e3c-9bcc-162b46c98132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787088fe-352d-4e3c-9bcc-162b46c98132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f995fa2e-452c-434b-b3ea-580d0d985462', 'volume_name': 'volume-f995fa2e-452c-434b-b3ea-580d0d985462', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18002e20-2aac-4dd8-baf7-d28965cf1caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18002e20-2aac-4dd8-baf7-d28965cf1caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eedb34a-d7f7-4c30-9a4c-f94aad88877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Volume f995fa2e-452c-434b-b3ea-580d0d985462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f995fa2e-452c-434b-b3ea-580d0d985462', 'volume_size': 1} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:39 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d" returned: 0 in 0.792s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-653805775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b603bd3e-46ac-4dcc-9bee-28ba1096dc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07e4a5806094e5eb8c92160c0a596bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:38Z,use_quota=True,user_id='a1d19f41b815498abd0b965fdd4daffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d125c9c-8cd3-424f-a593-6c6626f8a7e1),volume_type_id=6d125c9c-8cd3-424f-a593-6c6626f8a7e1)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Creating volume b603bd3e-46ac-4dcc-9bee-28ba1096dc90 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:39 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b59a83-f39d-4f93-a5fe-51e1e03730d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 1073741824 Jul 10 19:42:39 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709073ae-2cb8-4087-916b-c5b8edb81f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d (b400b06b-8f5c-432d-825b-1bbcc0b2363d): created successfully Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709073ae-2cb8-4087-916b-c5b8edb81f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Flow 'volume_create_manager' (6f256725-1a90-4a65-ba5a-28f60f49fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Acquiring lock "cinder-855e9aba-a871-4ecb-a91c-75757e56bca0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:39 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cc43e8e6-52b8-401a-a611-c78ad17ac488 tempest-TestInstancesWithCinderVolumes-1269473727 None] Created volume successfully. Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-855e9aba-a871-4ecb-a91c-75757e56bca0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Acquiring lock "cinder-quobyte-855e9aba-a871-4ecb-a91c-75757e56bca0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-quobyte-855e9aba-a871-4ecb-a91c-75757e56bca0" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b85ad1-ae68-4747-a204-dfb9e3175bbe]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:40 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 Jul 10 19:42:40 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:40 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 1073741824" returned: 0 in 0.883s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:40 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 Jul 10 19:42:40 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:40 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0" returned: 0 in 0.863s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:40 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0 Jul 10 19:42:40 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:41 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-887022344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f995fa2e-452c-434b-b3ea-580d0d985462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20856b41537b4a93bd49a8d091c5b2bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:39Z,use_quota=True,user_id='330bfd296ae64d9db1b8a4316ee124b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Creating volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:41 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69ca63b-350b-4dfd-a372-097458dc8395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:41 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 1073741824 Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767bafe6-2b77-4ec0-b2f5-684390bde734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:41 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 (b603bd3e-46ac-4dcc-9bee-28ba1096dc90): created successfully Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767bafe6-2b77-4ec0-b2f5-684390bde734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Flow 'volume_create_manager' (8b82ae83-906b-4596-a156-b5693a95cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7d515aa6-1056-4d9b-8529-dfe4aa26c38d tempest-TestInstancesWithCinderVolumes-1269473727 None] Created volume successfully. Jul 10 19:42:41 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-855e9aba-a871-4ecb-a91c-75757e56bca0" returned: 0 in 0.704s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-quobyte-855e9aba-a871-4ecb-a91c-75757e56bca0" released by "delete_volume" :: held 1.611s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Created reservations ['3ac68457-e597-456c-8828-4ee34ea65c7c', 'f0dc9608-baef-46f1-9865-5e10bb7c3845', '0fc4ad07-d4e6-4e1d-bc54-aa90bf81ec56', 'e25a37ad-8359-448e-b7cb-069eab65df69'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:41 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:41 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:42 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.773s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Deleted volume successfully. Jul 10 19:42:42 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 1073741824" returned: 0 in 1.090s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0749e95-e066-4cff-b33c-c4589d59cc5b tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-855e9aba-a871-4ecb-a91c-75757e56bca0-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:42 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 Jul 10 19:42:42 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Flow 'volume_create_manager' (c6807c26-86d9-47b4-8169-30b4086429e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92446f7-7e53-4bfc-9b80-2e7a8de05377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92446f7-7e53-4bfc-9b80-2e7a8de05377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2031934274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b412110e-8ce8-479a-97a6-978445359b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ba6450d964b14b03cea459bbd090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:43Z,use_quota=True,user_id='fb80e2193016486b81129c9ff5472631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d96a47-b8f8-4c30-859a-95a07192f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d96a47-b8f8-4c30-859a-95a07192f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4430efff-8d98-451a-b738-935e53e0b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4430efff-8d98-451a-b738-935e53e0b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b412110e-8ce8-479a-97a6-978445359b20', 'volume_name': 'volume-b412110e-8ce8-479a-97a6-978445359b20', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b17559d-1d85-41a3-b5ae-e370a74fa755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b17559d-1d85-41a3-b5ae-e370a74fa755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ab657b-50e1-4788-a353-66a7fbbea4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Volume b412110e-8ce8-479a-97a6-978445359b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b412110e-8ce8-479a-97a6-978445359b20', 'volume_size': 1} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Flow 'volume_create_manager' (bc160479-6548-4896-b3c7-75eaad1ecc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e42f96d-30cf-4d0b-b793-9bff61d968ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e42f96d-30cf-4d0b-b793-9bff61d968ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2063372424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fc5fdc-ab8b-4c32-9bff-a91098422b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b959a6c5244611a90f3b1c5f4fe058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:43Z,use_quota=True,user_id='24e9588ca58c42d1a6fbee9579cee34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9eba4a-a9e6-41e5-8a1b-216e0ebb9e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9eba4a-a9e6-41e5-8a1b-216e0ebb9e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6329d6e-ca45-49fd-93f1-0e5a0f602b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6329d6e-ca45-49fd-93f1-0e5a0f602b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fc5fdc-ab8b-4c32-9bff-a91098422b78', 'volume_name': 'volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd57097-a6fd-46b7-8832-58772266bb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd57097-a6fd-46b7-8832-58772266bb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9a986b-846f-4d12-9ee6-ea83199b4bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Volume f2fc5fdc-ab8b-4c32-9bff-a91098422b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78', 'volume_size': 1} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:43 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462" returned: 0 in 0.762s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2031934274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b412110e-8ce8-479a-97a6-978445359b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ba6450d964b14b03cea459bbd090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:43Z,use_quota=True,user_id='fb80e2193016486b81129c9ff5472631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Creating volume b412110e-8ce8-479a-97a6-978445359b20 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:43 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:43 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 1073741824 Jul 10 19:42:43 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eedb34a-d7f7-4c30-9a4c-f94aad88877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f995fa2e-452c-434b-b3ea-580d0d985462', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d38ed3e-bb78-4942-85f9-d79acb7dcefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Volume volume-f995fa2e-452c-434b-b3ea-580d0d985462 (f995fa2e-452c-434b-b3ea-580d0d985462): created successfully Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d38ed3e-bb78-4942-85f9-d79acb7dcefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Flow 'volume_create_manager' (31975d17-3912-4a3f-ae87-2350a28a8714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b362f262-c9ec-43e2-aec7-704e492d6d0c tempest-SnapshotsActionsTest-221358520 None] Created volume successfully. Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD, size 20.69 MB, duration 4.38 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:42:43 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Image download 20.69 MB at 4.72 MB/s Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f5fc8-1bf0-407a-87ba-ced02bbcc159]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:43 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD Jul 10 19:42:43 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:44 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 1073741824" returned: 0 in 0.889s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:44 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 Jul 10 19:42:44 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:44 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Temporary image 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 is fetched for user a1d19f41b815498abd0b965fdd4daffd. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd59d941-2427-4fac-aaeb-608c250db862]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:44 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD Jul 10 19:42:44 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:44 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20" returned: 0 in 0.631s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2063372424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fc5fdc-ab8b-4c32-9bff-a91098422b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b959a6c5244611a90f3b1c5f4fe058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:43Z,use_quota=True,user_id='24e9588ca58c42d1a6fbee9579cee34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Creating volume f2fc5fdc-ab8b-4c32-9bff-a91098422b78 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:44 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ab657b-50e1-4788-a353-66a7fbbea4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b412110e-8ce8-479a-97a6-978445359b20', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:44 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 1073741824 Jul 10 19:42:44 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92581236-1658-46fa-9600-e652254eb622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:44 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Volume volume-b412110e-8ce8-479a-97a6-978445359b20 (b412110e-8ce8-479a-97a6-978445359b20): created successfully Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92581236-1658-46fa-9600-e652254eb622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Flow 'volume_create_manager' (c6807c26-86d9-47b4-8169-30b4086429e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-630b0fc5-e9e4-40ef-8b2c-55980ead27eb tempest-AttachVolumeTestJSON-234969277 None] Created volume successfully. Jul 10 19:42:45 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:45 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 1073741824" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:45 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 Jul 10 19:42:45 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:46 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78" returned: 0 in 0.664s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.276s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9a986b-846f-4d12-9ee6-ea83199b4bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87152365-80fe-4ce9-99b7-74e3c1e21323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Creating offline snapshot f352ec8b-e1a2-445f-9935-f495ef33b684 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:42:46 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Volume volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 (f2fc5fdc-ab8b-4c32-9bff-a91098422b78): created successfully Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87152365-80fe-4ce9-99b7-74e3c1e21323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Flow 'volume_create_manager' (bc160479-6548-4896-b3c7-75eaad1ecc20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[700b9778-1071-4b10-adc4-e0ef0eedcc54]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7e46e0c9-0307-4c74-a5a4-b92766729a7e tempest-VolumesTransfersV355Test-1544014128 None] Created volume successfully. Jul 10 19:42:46 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 Jul 10 19:42:46 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:47 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462" returned: 0 in 0.794s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:47 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 1G Jul 10 19:42:47 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Acquiring lock "cinder-f2fc5fdc-ab8b-4c32-9bff-a91098422b78-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-f2fc5fdc-ab8b-4c32-9bff-a91098422b78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Acquiring lock "cinder-quobyte-f2fc5fdc-ab8b-4c32-9bff-a91098422b78" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-quobyte-f2fc5fdc-ab8b-4c32-9bff-a91098422b78" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de1cd2e-d8d1-4432-8660-02e791522867]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:47 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 Jul 10 19:42:47 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:47 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 1G" returned: 0 in 0.816s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:48 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:42:48 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:48 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78" returned: 0 in 0.860s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:48 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78 Jul 10 19:42:48 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:48 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.745s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:48 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 is being set with open permissions: ugo+rw Jul 10 19:42:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:48 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:42:48 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:48 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f2fc5fdc-ab8b-4c32-9bff-a91098422b78" returned: 0 in 0.660s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-quobyte-f2fc5fdc-ab8b-4c32-9bff-a91098422b78" released by "delete_volume" :: held 1.590s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Created reservations ['fb0a7f12-91d5-4f5e-ac46-7be3039263d3', '67642e04-e777-4d2f-9a51-756f7121778b', '6c20c137-1da4-4937-a756-ab5d9a6b9010', 'dbe35ac9-faca-4227-8226-0d9fd491d419'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:49 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:42:49 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:49 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:49 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info Jul 10 19:42:49 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:49 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.683s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:42:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Deleted volume successfully. Jul 10 19:42:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d0e667a8-163e-4d9e-af83-fcd3e0c77418 tempest-VolumesTransfersV355Test-529554474 None] Lock "cinder-f2fc5fdc-ab8b-4c32-9bff-a91098422b78-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:42:50 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info" returned: 0 in 0.725s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:50 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info is being set with open permissions: ugo+rw Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:50 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info Jul 10 19:42:50 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:50 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.info" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.559s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.584s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1212729213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07e4a5806094e5eb8c92160c0a596bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:39Z,use_quota=True,user_id='a1d19f41b815498abd0b965fdd4daffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7672fb6b-d640-4d10-bfd7-9a8da431e811),volume_type_id=7672fb6b-d640-4d10-bfd7-9a8da431e811)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Creating volume 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:50 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:50 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf 1073741824 Jul 10 19:42:50 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b0e28288-67ab-4d1e-8bd2-eeaa6390a6a1 tempest-SnapshotsActionsTest-221358520 None] Create snapshot completed successfully Jul 10 19:42:51 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf 1073741824" returned: 0 in 1.008s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:51 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:42:51 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:52 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 0 in 0.710s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.592s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e400b5b-cf87-4d58-af3c-fe7310dfc4d6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Attempting download of 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'metadata': {}}])) to volume 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa1f6a9-10fa-4b41-a2c2-fca8e12b7460]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:52 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 Jul 10 19:42:52 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:52 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r Jul 10 19:42:52 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:53 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20" returned: 0 in 0.867s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.509s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Creating offline snapshot b9284cc2-1260-423e-b4f2-b4efad1815f4 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:42:53 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r" returned: 0 in 0.824s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa16ddf6-8be6-4fbd-965c-470b17b72e54]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-b412110e-8ce8-479a-97a6-978445359b20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6130909-52b4-4a0b-a661-31368ec00c36', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:42:53 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-a8107b86-23a5-418a-bccb-b9e5e48bb069 req-c15ce936-dd21-4ae2-a3aa-d74805d0713b tempest-AttachVolumeTestJSON-234969277 None] attachment_update completed successfully. Jul 10 19:42:53 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r Jul 10 19:42:53 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:53 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:42:53 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:54 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r" returned: 1 in 0.881s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_ql1omj0r' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a359881-42cb-4a25-a553-c3837039c738]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:54 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:42:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:54 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 1G Jul 10 19:42:54 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:54 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD Jul 10 19:42:54 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Flow 'volume_create_manager' (ba9f5257-0a22-42cf-8372-44eed5720437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c26719-e936-4619-9279-c5a7928a4322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c26719-e936-4619-9279-c5a7928a4322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1421689320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d34c1226bc44dc68f8cde552ad39b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:55Z,use_quota=True,user_id='759a38c4c6b94ece9c2071f1e85ad969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6a391a-d8c8-4d5f-8ed0-939ef264a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6a391a-d8c8-4d5f-8ed0-939ef264a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec0b6a-539d-4356-82be-46f0525df62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec0b6a-539d-4356-82be-46f0525df62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'volume_name': 'volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f392c55c-8dca-412f-8296-29258d3951ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f392c55c-8dca-412f-8296-29258d3951ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2ff99e-9761-41b0-ae46-530d58dacbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:55 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Volume 0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'volume_size': 1} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:55 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 was qcow2, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:55 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:42:55 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:55 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 1G" returned: 0 in 1.057s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:55 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 Jul 10 19:42:55 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:56 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4" returned: 0 in 0.736s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:56 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 is being set with open permissions: ugo+rw Jul 10 19:42:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:56 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 Jul 10 19:42:56 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:57 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4" returned: 0 in 0.699s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.547s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1421689320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d34c1226bc44dc68f8cde552ad39b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:42:55Z,use_quota=True,user_id='759a38c4c6b94ece9c2071f1e85ad969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Creating volume 0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:42:57 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:57 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee 1073741824 Jul 10 19:42:57 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-24dce8ee-bf77-4c6d-a49c-b57311e7a0fd tempest-SnapshotsActionsTest-221358520 None] Create snapshot completed successfully Jul 10 19:42:57 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 0 in 1.925s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_626a1a5d-91cf-45a5-bd04-2e0cdcde84d5_szzcj_widevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:42:57 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Converted 112.00 MB image at 58.06 MB/s Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:57 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf 1G Jul 10 19:42:57 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-b9284cc2-1260-423e-b4f2-b4efad1815f4-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-b9284cc2-1260-423e-b4f2-b4efad1815f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-b9284cc2-1260-423e-b4f2-b4efad1815f4" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-b9284cc2-1260-423e-b4f2-b4efad1815f4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Deleting offline snapshot b9284cc2-1260-423e-b4f2-b4efad1815f4 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] snapshot_file for this snap is: volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136b2ad-77fd-48f7-8fbd-8002c7d485fe]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:57 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 Jul 10 19:42:57 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:58 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf 1G" returned: 0 in 0.744s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:58 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee 1073741824" returned: 0 in 0.970s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ffba4d-2371-497e-b617-e0c7074b8e08]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:58 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:42:58 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:58 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:42:58 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:58 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4" returned: 0 in 0.854s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6856d1ce-4812-41e8-8714-9b4b28df65bd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:58 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:42:58 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:58 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 0.704s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2ff99e-9761-41b0-ae46-530d58dacbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9effa2-e664-4dfa-8a11-b205c064d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:42:58 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Volume volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee (0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee): created successfully Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9effa2-e664-4dfa-8a11-b205c064d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:42:58 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Flow 'volume_create_manager' (ba9f5257-0a22-42cf-8372-44eed5720437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:42:58 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0ca943fe-61a8-47c2-aab3-73d444e4626b tempest-VolumesCloneTest-832073030 None] Created volume successfully. Jul 10 19:42:59 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 0 in 0.971s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:59 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:42:59 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:59 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.903s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:42:59 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 Jul 10 19:42:59 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:42:59 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 1 in 0.852s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Downloaded image 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'metadata': {}}])) to volume 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Temporary image 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 for user a1d19f41b815498abd0b965fdd4daffd is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Marking volume 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Copying metadata from image 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 to 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Creating volume glance metadata for volume 3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf backed by image 626a1a5d-91cf-45a5-bd04-2e0cdcde84d5 with: {'image_id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'image_name': 'tempest-scenario-img--129548025', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:42:59 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Flow 'volume_create_manager' (a4a1215f-476a-4814-9162-7b0082f14b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642d0ee1-c640-4459-9e10-204e0b7d4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642d0ee1-c640-4459-9e10-204e0b7d4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1135548698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10a3f2e-4558-4046-8c0d-e752fd8cbfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d34c1226bc44dc68f8cde552ad39b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:00Z,use_quota=True,user_id='759a38c4c6b94ece9c2071f1e85ad969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09851969-e67a-4bbb-8e10-0c73c6fd6adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09851969-e67a-4bbb-8e10-0c73c6fd6adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b7aff6-effe-413c-8836-6c9214d8704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b7aff6-effe-413c-8836-6c9214d8704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b10a3f2e-4558-4046-8c0d-e752fd8cbfd7', 'volume_name': 'volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7', 'volume_size': 2, 'source_volid': '0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'source_volstatus': 'available'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65579e70-c927-4474-b017-2fc00308d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65579e70-c927-4474-b017-2fc00308d452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0ce6c9-290b-4bfe-8985-f4edbc8e9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Volume b10a3f2e-4558-4046-8c0d-e752fd8cbfd7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7', 'volume_size': 2, 'source_volid': '0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'source_volstatus': 'available'} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:00 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Cloning volume 0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee to volume b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe76c68f-db41-400f-a505-3a04c09366d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf', 'volume_size': 1, 'image_id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--129548025', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd07e4a5806094e5eb8c92160c0a596bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '626a1a5d-91cf-45a5-bd04-2e0cdcde84d5', 'created_at': datetime.datetime(2026, 7, 10, 17, 42, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 42, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/626a1a5d-91cf-45a5-bd04-2e0cdcde84d5/file', 'properties': {}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3623848f-90f2-4c90-8018-57d7dfd6265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Creating offline snapshot 9334c87b-be9c-4acf-b6a2-7e7735a38d97 of volume 0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:43:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Volume volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf (3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf): created successfully Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3623848f-90f2-4c90-8018-57d7dfd6265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Flow 'volume_create_manager' (69c18591-fbe6-404f-8425-9b47ecc0c763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5c0f17-f772-4810-85cd-f9288a6a9edb]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9dae09b8-594f-4b38-931a-52cc6b10287b tempest-TestInstancesWithCinderVolumes-1269473727 None] Created volume successfully. Jul 10 19:43:00 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:43:00 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:00 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4" returned: 0 in 0.855s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:00 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4 Jul 10 19:43:00 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:01 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 0.831s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:01 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 1G Jul 10 19:43:01 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:01 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.b9284cc2-1260-423e-b4f2-b4efad1815f4" returned: 0 in 0.746s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-b9284cc2-1260-423e-b4f2-b4efad1815f4" released by "_delete_snapshot" :: held 3.469s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" released by "delete_snapshot" :: held 3.502s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Created reservations ['7a9a88e1-f3a6-418a-8c3e-d56881d21b8b', '4022fccd-770b-4ca3-ae42-a6c47b52b3ec', '8fbdcd37-cc27-4fa4-a3e0-fac05c78e67f', '86b20f7b-a7f4-4fd9-ae4e-5d12023dbf87'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Delete snapshot completed successfully. Jul 10 19:43:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ce39af1b-8089-4c40-a707-337faf1034c1 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-b9284cc2-1260-423e-b4f2-b4efad1815f4-delete_snapshot" released by "delete_snapshot" :: held 3.691s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:02 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 1G" returned: 0 in 1.064s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:02 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 Jul 10 19:43:02 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:02 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97" returned: 0 in 0.788s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:02 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 is being set with open permissions: ugo+rw Jul 10 19:43:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:02 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 Jul 10 19:43:02 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:03 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97" returned: 0 in 0.708s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:03 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info Jul 10 19:43:03 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:04 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info" returned: 0 in 0.686s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:04 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info is being set with open permissions: ugo+rw Jul 10 19:43:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:04 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info Jul 10 19:43:04 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:04 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.info" returned: 0 in 0.667s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Acquiring lock "cinder-quobyte-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] snapshot: 9334c87b-be9c-4acf-b6a2-7e7735a38d97, volume: b10a3f2e-4558-4046-8c0d-e752fd8cbfd7, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0df4ad2-fabf-4359-97a7-2ee97971d7bd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:05 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 Jul 10 19:43:05 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:05 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97" returned: 0 in 0.849s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0681e-9fcf-4dc4-9f23-35809297684d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:06 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:43:06 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:06 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:06 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:43:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:06 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 Jul 10 19:43:06 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:08 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=99,cinder:UPDATE=102,cinder:INSERT=28,cinder:DELETE=12 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:43:09 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=86,cinder:UPDATE=102,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:43:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:13 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" returned: 0 in 6.858s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:13 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6fc6e-a84f-45bd-a980-d385db3b6915]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:13 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:43:13 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:14 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 1.111s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:14 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:43:14 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Converted 1024.00 MB image at 149.29 MB/s Jul 10 19:43:14 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 is being set with open permissions: ugo+rw Jul 10 19:43:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:14 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 Jul 10 19:43:14 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:15 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" released by "_copy_volume_from_snapshot" :: held 10.566s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Acquiring lock "cinder-quobyte-9334c87b-be9c-4acf-b6a2-7e7735a38d97" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-9334c87b-be9c-4acf-b6a2-7e7735a38d97" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Deleting offline snapshot 9334c87b-be9c-4acf-b6a2-7e7735a38d97 of volume 0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] snapshot_file for this snap is: volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edeebb3-bd65-4eec-b33d-0e04941919cd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:15 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 Jul 10 19:43:15 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:16 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:16 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c01ed-ba60-490d-8313-43748ce9ad00]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:16 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:43:16 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:17 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 0.827s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:17 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 Jul 10 19:43:17 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:18 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97" returned: 0 in 0.757s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:18 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97 Jul 10 19:43:18 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:18 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee.9334c87b-be9c-4acf-b6a2-7e7735a38d97" returned: 0 in 0.632s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-9334c87b-be9c-4acf-b6a2-7e7735a38d97" released by "_delete_snapshot" :: held 3.141s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.648s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.486s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Creating offline snapshot e95da1d2-cb74-43da-a920-b987b6ee2a18 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0ce6c9-290b-4bfe-8985-f4edbc8e9149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7', 'volume_size': 2, 'source_volid': '0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee', 'source_volstatus': 'available'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8774185a-b1b6-4c3c-a642-638e38853513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf714e7a-de37-4ebf-a94e-17cf00c00aff]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:18 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Volume volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 (b10a3f2e-4558-4046-8c0d-e752fd8cbfd7): created successfully Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8774185a-b1b6-4c3c-a642-638e38853513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Flow 'volume_create_manager' (a4a1215f-476a-4814-9162-7b0082f14b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d76115d1-1a63-42f1-84cc-c077c771a491 tempest-VolumesCloneTest-832073030 None] Created volume successfully. Jul 10 19:43:18 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:18 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:19 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.772s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:19 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 1G Jul 10 19:43:19 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Acquiring lock "cinder-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Lock "cinder-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Acquiring lock "cinder-quobyte-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f47a36-d546-47b9-9320-7ae3dcb36c2c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:20 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 Jul 10 19:43:20 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:20 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 1G" returned: 0 in 0.976s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:20 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 Jul 10 19:43:20 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:20 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:20 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7 Jul 10 19:43:20 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:21 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18" returned: 0 in 0.749s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:21 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 is being set with open permissions: ugo+rw Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:21 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 Jul 10 19:43:21 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:21 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" returned: 0 in 0.932s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7" released by "delete_volume" :: held 1.825s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Created reservations ['33660993-1adf-4c0a-87b7-1e1c4048fa0f', '5120949e-c26c-484f-ac11-9b2e94ba17c9', '6c12e0d3-1b29-4bae-8455-d61abd043b19', 'cde68005-cb91-43fd-8c78-a4f4defea56d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:21 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:22 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:22 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.058s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-eaf8b478-10b8-479b-b565-49572d0b78ee tempest-SnapshotsActionsTest-221358520 None] Create snapshot completed successfully Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8cd6c-ee36-4cce-a390-5233893ab39c]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Acquiring lock "cinder-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:22 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:43:22 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Lock "cinder-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Acquiring lock "cinder-quobyte-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" acquired by "delete_volume" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cc88a4-bf6b-4944-a8b2-02ad5c1f06ed]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:22 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:43:22 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:22 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.900s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Deleted volume successfully. Jul 10 19:43:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8ef0b17-de1f-4dc4-a0dd-b4d295a3fc39 tempest-VolumesCloneTest-832073030 None] Lock "cinder-b10a3f2e-4558-4046-8c0d-e752fd8cbfd7-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:23 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 0 in 1.010s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-e95da1d2-cb74-43da-a920-b987b6ee2a18-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-e95da1d2-cb74-43da-a920-b987b6ee2a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-e95da1d2-cb74-43da-a920-b987b6ee2a18" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-e95da1d2-cb74-43da-a920-b987b6ee2a18" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Deleting offline snapshot e95da1d2-cb74-43da-a920-b987b6ee2a18 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:43:23 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:43:23 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] snapshot_file for this snap is: volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc98e1-e356-4c0f-a30c-00e4aa88388f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:23 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 Jul 10 19:43:23 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:23 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 1.131s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:23 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee Jul 10 19:43:23 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:23 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 1 in 0.801s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.884s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1781b8d9-a32f-47f2-ba47-f6eaf9a0824a', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:43:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-5168965b-c88d-4155-8a4b-14605c82d582 req-2e0ea6d3-2235-422f-94be-0b8a98ed42e0 tempest-TestInstancesWithCinderVolumes-1269473727 None] attachment_update completed successfully. Jul 10 19:43:24 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18" returned: 0 in 0.924s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c41adcb-ff3d-4b00-880a-57b0fb58e66c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:24 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" returned: 0 in 0.779s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Lock "cinder-quobyte-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee" released by "delete_volume" :: held 1.994s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:24 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:24 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Created reservations ['0161ecd9-296c-4192-b066-e2a710ca0f47', 'ba8cb936-8883-48ba-9534-627c2d625501', '114845ce-032b-4a96-99a4-019875d4020d', '5b62d29d-e947-4ffe-85ef-367183702c8a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:24 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:24 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:25 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.911s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:25 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 Jul 10 19:43:25 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:25 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:25 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Deleted volume successfully. Jul 10 19:43:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d47e2a51-1fc8-4c34-84f6-9de08754f9cb tempest-VolumesCloneTest-832073030 None] Lock "cinder-0f73754e-b2d2-4e73-9aea-d1cbc8d8b9ee-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:26 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18" returned: 0 in 0.941s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:26 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18 Jul 10 19:43:26 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:26 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.e95da1d2-cb74-43da-a920-b987b6ee2a18" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-e95da1d2-cb74-43da-a920-b987b6ee2a18" released by "_delete_snapshot" :: held 3.716s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" released by "delete_snapshot" :: held 3.743s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Created reservations ['d3fb2d84-5931-4e8f-8041-6df206e0f7b6', '997e409a-a1cc-4b20-ac54-446aa481625b', '5a80deff-b308-4b7e-8ed0-0c0a511d7651', '39751336-c0b4-4e46-9afe-6d597a4c578e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Delete snapshot completed successfully. Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-02700983-9ecc-4141-ae10-db9000ab1014 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-e95da1d2-cb74-43da-a920-b987b6ee2a18-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Creating offline snapshot abc80720-71ab-48e6-989e-414b5eba7cf9 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:43:28 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d758d1-2b11-4d96-8dab-9026587c3bfe]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:28 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:28 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:28 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.901s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:28 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 1G Jul 10 19:43:28 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Flow 'volume_create_manager' (f51c712f-30fd-4135-bc85-88d271898147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a5eb49-2f7e-476a-8135-fc31120231b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a5eb49-2f7e-476a-8135-fc31120231b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1934339074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d2bd25-6067-4c27-95fd-6b01fce70109,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='812d98f09297448ba4a72ef2efcbc2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:29Z,use_quota=True,user_id='6a1188af793941c5a366d72b6ce63267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fdf6ff-9e8e-49fb-869b-4dfa8af05068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fdf6ff-9e8e-49fb-869b-4dfa8af05068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827b1ed8-18b1-4aea-8a90-0fa32b93d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827b1ed8-18b1-4aea-8a90-0fa32b93d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d2bd25-6067-4c27-95fd-6b01fce70109', 'volume_name': 'volume-f5d2bd25-6067-4c27-95fd-6b01fce70109', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018643f2-1343-46be-b8ce-33d3bfb0e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018643f2-1343-46be-b8ce-33d3bfb0e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b248c62f-304f-48d0-9d59-fc60b88c91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Volume f5d2bd25-6067-4c27-95fd-6b01fce70109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d2bd25-6067-4c27-95fd-6b01fce70109', 'volume_size': 1} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:29 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 1G" returned: 0 in 1.009s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:29 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 Jul 10 19:43:29 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:30 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9" returned: 0 in 0.760s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:30 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 is being set with open permissions: ugo+rw Jul 10 19:43:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:30 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 Jul 10 19:43:30 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:31 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9" returned: 0 in 0.785s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1934339074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d2bd25-6067-4c27-95fd-6b01fce70109,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='812d98f09297448ba4a72ef2efcbc2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:29Z,use_quota=True,user_id='6a1188af793941c5a366d72b6ce63267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Creating volume f5d2bd25-6067-4c27-95fd-6b01fce70109 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:43:31 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:43:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:31 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 1073741824 Jul 10 19:43:31 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5c5e42dc-1935-4b7b-b50c-80aa1a9e5a00 tempest-SnapshotsActionsTest-221358520 None] Create snapshot completed successfully Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-abc80720-71ab-48e6-989e-414b5eba7cf9-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-abc80720-71ab-48e6-989e-414b5eba7cf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-abc80720-71ab-48e6-989e-414b5eba7cf9" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-abc80720-71ab-48e6-989e-414b5eba7cf9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Deleting offline snapshot abc80720-71ab-48e6-989e-414b5eba7cf9 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] snapshot_file for this snap is: volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ae436-9c09-4064-b41a-8c7670edada3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:32 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 Jul 10 19:43:32 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:32 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 1073741824" returned: 0 in 1.340s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:33 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 Jul 10 19:43:33 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:33 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9" returned: 0 in 1.351s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c58674-a945-4409-b928-b6aa102c05ca]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:33 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109" returned: 0 in 0.930s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b248c62f-304f-48d0-9d59-fc60b88c91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d2bd25-6067-4c27-95fd-6b01fce70109', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b09cdd5-5541-495b-82b0-9a3d79527ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:33 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Volume volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 (f5d2bd25-6067-4c27-95fd-6b01fce70109): created successfully Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b09cdd5-5541-495b-82b0-9a3d79527ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Flow 'volume_create_manager' (f51c712f-30fd-4135-bc85-88d271898147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3f487cd3-59c7-425a-bf65-c5c23ace6180 tempest-VolumesListTestJSON-1738405647 None] Created volume successfully. Jul 10 19:43:34 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:34 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:35 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 1.202s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:35 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 Jul 10 19:43:35 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:35 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Flow 'volume_create_manager' (042fe308-1937-47d7-a91c-4bef443caffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae27308a-5efa-499e-b6c4-4e61d850aab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae27308a-5efa-499e-b6c4-4e61d850aab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477215721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad74d323-b4bd-4a08-822a-115d5fa5cb2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='812d98f09297448ba4a72ef2efcbc2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:36Z,use_quota=True,user_id='6a1188af793941c5a366d72b6ce63267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d067b52d-b9e7-4fce-b298-56296f491ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d067b52d-b9e7-4fce-b298-56296f491ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d739211-458d-4e23-badb-c8e7e9301746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d739211-458d-4e23-badb-c8e7e9301746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad74d323-b4bd-4a08-822a-115d5fa5cb2b', 'volume_name': 'volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1940e3c-354a-4676-83ee-01811e625d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1940e3c-354a-4676-83ee-01811e625d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1b5116-bbc9-4824-a04a-71ad41d987a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:36 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Volume ad74d323-b4bd-4a08-822a-115d5fa5cb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b', 'volume_size': 1} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477215721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad74d323-b4bd-4a08-822a-115d5fa5cb2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='812d98f09297448ba4a72ef2efcbc2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:36Z,use_quota=True,user_id='6a1188af793941c5a366d72b6ce63267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Creating volume ad74d323-b4bd-4a08-822a-115d5fa5cb2b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:43:36 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:36 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b 1073741824 Jul 10 19:43:36 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:36 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9" returned: 0 in 1.582s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:36 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9 Jul 10 19:43:36 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:37 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:37 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:37 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.abc80720-71ab-48e6-989e-414b5eba7cf9" returned: 0 in 1.060s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-abc80720-71ab-48e6-989e-414b5eba7cf9" released by "_delete_snapshot" :: held 5.365s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" released by "delete_snapshot" :: held 5.413s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:37 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Created reservations ['e47fd186-547d-4bc9-b09f-546493aeb0a0', 'cc68e07f-4062-4ea7-9085-0d86e1bc6f39', '2a965cb3-42a0-4f4d-a69f-baa855512d5e', '31ef6bf1-0c79-4a79-95b0-8f5daee02d22'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Delete snapshot completed successfully. Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9a02a3e9-3342-4854-b28a-7cbdb6ef6613 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-abc80720-71ab-48e6-989e-414b5eba7cf9-delete_snapshot" released by "delete_snapshot" :: held 5.697s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:38 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b 1073741824" returned: 0 in 1.880s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:38 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b Jul 10 19:43:38 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-33232e1e-1b02-41ac-9d25-cab6cec9dd00 req-9eff7dec-8aa1-4763-8046-179184265c45 tempest-AttachVolumeTestJSON-234969277 None] Terminate volume connection completed successfully. Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-33232e1e-1b02-41ac-9d25-cab6cec9dd00 req-9eff7dec-8aa1-4763-8046-179184265c45 tempest-AttachVolumeTestJSON-234969277 None] Deleting attachment d6130909-52b4-4a0b-a661-31368ec00c36. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:43:38 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.048s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:43:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:43:39 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b" returned: 0 in 1.125s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] <== create_volume: return (3068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.074s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1b5116-bbc9-4824-a04a-71ad41d987a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99b2bc6-d71d-4141-864e-4ad7469f53e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Volume volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b (ad74d323-b4bd-4a08-822a-115d5fa5cb2b): created successfully Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99b2bc6-d71d-4141-864e-4ad7469f53e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Flow 'volume_create_manager' (042fe308-1937-47d7-a91c-4bef443caffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:39 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6330c329-21ce-4793-8847-8d7e26ef5fc9 tempest-VolumesListTestJSON-1738405647 None] Created volume successfully. Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Creating offline snapshot 4e013543-24d4-46d9-8935-fc11a635c132 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771c0c5-a567-48bd-a8b2-3c96236acaa0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:39 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:39 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:40 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.930s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:40 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 1G Jul 10 19:43:40 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Flow 'volume_create_manager' (d31f2695-5d01-4223-bfe3-a11ed7b93248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a3f6d1-6106-4c6c-894b-e6957baa96f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a3f6d1-6106-4c6c-894b-e6957baa96f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2080720597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8191a6d-1e53-4591-8856-e8a97eaa6f2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='812d98f09297448ba4a72ef2efcbc2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:41Z,use_quota=True,user_id='6a1188af793941c5a366d72b6ce63267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a2ebe1-c4ce-46b2-b628-090a59858149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a2ebe1-c4ce-46b2-b628-090a59858149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166f80ba-03f4-42f6-903f-4bf1352cbb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166f80ba-03f4-42f6-903f-4bf1352cbb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8191a6d-1e53-4591-8856-e8a97eaa6f2b', 'volume_name': 'volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6afc27-0ba8-4bc3-a019-24d16d27a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6afc27-0ba8-4bc3-a019-24d16d27a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a95dc60-7d04-4d5a-9ae1-46e5af258f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Volume f8191a6d-1e53-4591-8856-e8a97eaa6f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b', 'volume_size': 1} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:41 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 1G" returned: 0 in 1.144s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:41 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 Jul 10 19:43:41 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:42 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132" returned: 0 in 0.765s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:42 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 is being set with open permissions: ugo+rw Jul 10 19:43:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:42 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 Jul 10 19:43:42 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:43 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132" returned: 0 in 0.690s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.702s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.772s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2080720597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8191a6d-1e53-4591-8856-e8a97eaa6f2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='812d98f09297448ba4a72ef2efcbc2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:43:41Z,use_quota=True,user_id='6a1188af793941c5a366d72b6ce63267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Creating volume f8191a6d-1e53-4591-8856-e8a97eaa6f2b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:43:43 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:43 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b 1073741824 Jul 10 19:43:43 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-22ba2ad4-789e-4032-98dc-a4c06d6374bc tempest-SnapshotsActionsTest-221358520 None] Create snapshot completed successfully Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-4e013543-24d4-46d9-8935-fc11a635c132-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-4e013543-24d4-46d9-8935-fc11a635c132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Acquiring lock "cinder-quobyte-4e013543-24d4-46d9-8935-fc11a635c132" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-4e013543-24d4-46d9-8935-fc11a635c132" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Deleting offline snapshot 4e013543-24d4-46d9-8935-fc11a635c132 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] snapshot_file for this snap is: volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd1e478-ff7d-4dca-b91f-2f489b8f54c4]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:44 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 Jul 10 19:43:44 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:44 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b 1073741824" returned: 0 in 0.882s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:44 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b Jul 10 19:43:44 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:44 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132" returned: 0 in 0.881s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adcce19-5f8a-42a6-a03c-797d1b92e779]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:44 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b" returned: 0 in 0.697s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a95dc60-7d04-4d5a-9ae1-46e5af258f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada0396-75ad-4d5e-a266-674a6f0fe45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:43:44 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Volume volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b (f8191a6d-1e53-4591-8856-e8a97eaa6f2b): created successfully Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada0396-75ad-4d5e-a266-674a6f0fe45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:43:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Flow 'volume_create_manager' (d31f2695-5d01-4223-bfe3-a11ed7b93248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:43:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c0dc4248-7893-46c7-a64a-2bb0a20d41af tempest-VolumesListTestJSON-1738405647 None] Created volume successfully. Jul 10 19:43:44 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:44 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:45 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.974s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:45 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 Jul 10 19:43:45 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:46 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132" returned: 0 in 1.048s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:46 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132 Jul 10 19:43:46 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:47 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.4e013543-24d4-46d9-8935-fc11a635c132" returned: 0 in 0.711s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-4e013543-24d4-46d9-8935-fc11a635c132" released by "_delete_snapshot" :: held 3.732s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" released by "delete_snapshot" :: held 3.760s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Created reservations ['dc224105-f04f-4e5e-ab90-54c7757cc7d9', 'bce84741-a99f-4778-bc21-c2b49e839fae', '411793b6-7ac1-4be4-912b-319aa5286aa7', '54b3126b-2ae5-49dd-8775-71e8d74c4fed'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Delete snapshot completed successfully. Jul 10 19:43:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4db00f25-3c14-4264-b893-a113ea8e3d37 tempest-SnapshotsActionsTest-1775462962 None] Lock "cinder-4e013543-24d4-46d9-8935-fc11a635c132-delete_snapshot" released by "delete_snapshot" :: held 3.922s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "cinder-f8191a6d-1e53-4591-8856-e8a97eaa6f2b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-f8191a6d-1e53-4591-8856-e8a97eaa6f2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "cinder-quobyte-f8191a6d-1e53-4591-8856-e8a97eaa6f2b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-quobyte-f8191a6d-1e53-4591-8856-e8a97eaa6f2b" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[072a4c1d-85b9-46a9-b4b0-561de3ee7011]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "cinder-f352ec8b-e1a2-445f-9935-f495ef33b684-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-f352ec8b-e1a2-445f-9935-f495ef33b684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "cinder-quobyte-f352ec8b-e1a2-445f-9935-f495ef33b684" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-quobyte-f352ec8b-e1a2-445f-9935-f495ef33b684" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Deleting offline snapshot f352ec8b-e1a2-445f-9935-f495ef33b684 of volume f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] snapshot_file for this snap is: volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e3917-1567-4b69-9fcc-feebc9baafde]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:48 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b Jul 10 19:43:48 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:48 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:48 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:49 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b" returned: 0 in 0.838s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:49 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b Jul 10 19:43:49 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:49 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.816s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f995fa2e-452c-434b-b3ea-580d0d985462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:43:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[957973dc-e92a-471a-ba6c-8a6919ea0708]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:49 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 Jul 10 19:43:49 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:50 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f8191a6d-1e53-4591-8856-e8a97eaa6f2b" returned: 0 in 0.675s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-quobyte-f8191a6d-1e53-4591-8856-e8a97eaa6f2b" released by "delete_volume" :: held 1.561s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Created reservations ['d6fef00a-ae65-4c88-8e44-771627fb50c8', 'a362b099-346d-4bdc-b385-dcc7ea69d358', '38882322-922e-4cc6-95bb-7f4f6ed5a67e', '5ebd23d7-abea-468a-ba5b-b2eb70da7d05'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:50 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:50 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:50 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462" returned: 0 in 0.772s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:50 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:50 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "cinder-ad74d323-b4bd-4a08-822a-115d5fa5cb2b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-ad74d323-b4bd-4a08-822a-115d5fa5cb2b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "cinder-quobyte-ad74d323-b4bd-4a08-822a-115d5fa5cb2b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-quobyte-ad74d323-b4bd-4a08-822a-115d5fa5cb2b" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:51 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.870s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Deleted volume successfully. Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd4030-f7b5-416c-a2a1-155e5a54fa7b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-04f433c0-6787-4948-83e4-8573bac926c7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-f8191a6d-1e53-4591-8856-e8a97eaa6f2b-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:51 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b Jul 10 19:43:51 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:51 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 1.293s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:51 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684 Jul 10 19:43:51 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:52 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b" returned: 0 in 1.119s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:52 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b Jul 10 19:43:52 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:52 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462.f352ec8b-e1a2-445f-9935-f495ef33b684" returned: 0 in 0.968s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-quobyte-f352ec8b-e1a2-445f-9935-f495ef33b684" released by "_delete_snapshot" :: held 3.959s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" released by "delete_snapshot" :: held 3.986s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Created reservations ['2b04fc70-0892-479f-958c-a82ce43aaa58', '1dd18c80-3156-4fbc-b2cb-69760f163d22', '53bba202-1949-4a61-b640-deb136b8537d', '64a1c136-86a2-4415-85fa-6bfee899013b'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Delete snapshot completed successfully. Jul 10 19:43:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9eaaedda-3c92-45e5-a448-01da6543ab21 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-f352ec8b-e1a2-445f-9935-f495ef33b684-delete_snapshot" released by "delete_snapshot" :: held 4.130s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "cinder-f995fa2e-452c-434b-b3ea-580d0d985462-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-f995fa2e-452c-434b-b3ea-580d0d985462-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:53 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad74d323-b4bd-4a08-822a-115d5fa5cb2b" returned: 0 in 0.931s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d23fee-7f30-4a55-83d8-19850d767adc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-quobyte-ad74d323-b4bd-4a08-822a-115d5fa5cb2b" released by "delete_volume" :: held 2.155s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Created reservations ['d4d3f68b-153c-4e89-a1e2-840561c29dd5', '6e15de12-269a-4e86-b352-a3d7b0b52827', '1b27ea5d-d7f9-4325-b057-2d3dcede8b99', '84dd3ea6-8c4b-4a15-b329-77b23c186a17'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:53 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 Jul 10 19:43:53 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:53 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:53 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:54 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.993s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Deleted volume successfully. Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-701fb190-a870-4f2c-937c-c724cd48e653 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-ad74d323-b4bd-4a08-822a-115d5fa5cb2b-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "cinder-f5d2bd25-6067-4c27-95fd-6b01fce70109-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:54 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-f5d2bd25-6067-4c27-95fd-6b01fce70109-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462" returned: 0 in 1.347s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:54 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462 Jul 10 19:43:54 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "cinder-quobyte-f5d2bd25-6067-4c27-95fd-6b01fce70109" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-quobyte-f5d2bd25-6067-4c27-95fd-6b01fce70109" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dee544-bca8-41f5-bb1c-d6ffadce3a6e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:43:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:54 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 Jul 10 19:43:54 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:55 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f995fa2e-452c-434b-b3ea-580d0d985462" returned: 0 in 0.902s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-quobyte-f995fa2e-452c-434b-b3ea-580d0d985462" released by "delete_volume" :: held 2.358s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Created reservations ['5b11c6cd-3a29-421e-a1d5-646f33acc915', 'b444f859-df05-4438-a4e4-b4c37786c9e1', '4e230b18-bab4-4d95-873b-2640ebfdbee3', 'be424851-2cde-48c4-8cf7-6ea059aa5086'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:55 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109" returned: 0 in 1.032s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:55 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:55 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:55 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109 Jul 10 19:43:55 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:56 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:56 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Deleted volume successfully. Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f05c3faa-0a75-4819-923e-24f0b132bc24 tempest-SnapshotsActionsTest-221358520 None] Lock "cinder-f995fa2e-452c-434b-b3ea-580d0d985462-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:56 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f5d2bd25-6067-4c27-95fd-6b01fce70109" returned: 0 in 0.819s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-quobyte-f5d2bd25-6067-4c27-95fd-6b01fce70109" released by "delete_volume" :: held 1.905s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Created reservations ['7b1ae062-e795-4f99-a9c0-8f8a54f4275a', 'fc30a7c8-9756-422a-87ad-dd51f41bf00f', '57074b19-0fcc-40c7-9494-ed3694eff093', '83aa424f-2b62-4e8f-a292-2faaea7b0a2a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:43:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:43:56 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:43:56 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:43:57 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 10 19:43:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.791s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:43:57 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:43:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Deleted volume successfully. Jul 10 19:43:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c2f743ee-3d2b-49e9-ac3f-b676edc930b7 tempest-VolumesListTestJSON-1738405647 None] Lock "cinder-f5d2bd25-6067-4c27-95fd-6b01fce70109-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Flow 'volume_create_manager' (1c65b959-b683-4d0c-b657-3175d36e3fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67321e4-a06d-4c20-a9a1-884283c6e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67321e4-a06d-4c20-a9a1-884283c6e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-951831455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037a155d-a59e-407b-b7bd-66cc5509d6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fb4444f26e4faab08a787c925c5b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:03Z,use_quota=True,user_id='d06859ddc8db41e7800ae49d1bb5ed79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1407699a-534a-481e-a5a0-b3549e5cc70e),volume_type_id=1407699a-534a-481e-a5a0-b3549e5cc70e)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edede03-5469-4422-af8b-4004181c096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edede03-5469-4422-af8b-4004181c096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac7a71a-001e-4558-918b-5ff7695163aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac7a71a-001e-4558-918b-5ff7695163aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037a155d-a59e-407b-b7bd-66cc5509d6fb', 'volume_name': 'volume-037a155d-a59e-407b-b7bd-66cc5509d6fb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409ea31-7f89-4865-8bb8-0189041e5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409ea31-7f89-4865-8bb8-0189041e5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a815f-3806-4d2b-819d-c5164a9f709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:03 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Volume 037a155d-a59e-407b-b7bd-66cc5509d6fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037a155d-a59e-407b-b7bd-66cc5509d6fb', 'volume_size': 1} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-951831455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037a155d-a59e-407b-b7bd-66cc5509d6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fb4444f26e4faab08a787c925c5b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:03Z,use_quota=True,user_id='d06859ddc8db41e7800ae49d1bb5ed79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1407699a-534a-481e-a5a0-b3549e5cc70e),volume_type_id=1407699a-534a-481e-a5a0-b3549e5cc70e)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Creating volume 037a155d-a59e-407b-b7bd-66cc5509d6fb {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:44:03 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:44:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:03 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb 1073741824 Jul 10 19:44:03 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:04 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb 1073741824" returned: 0 in 1.056s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:04 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb Jul 10 19:44:04 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:05 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb" returned: 0 in 0.869s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.051s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a815f-3806-4d2b-819d-c5164a9f709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037a155d-a59e-407b-b7bd-66cc5509d6fb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224edd8a-9d6e-40df-aefe-70e12894c285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e6183-05a8-4de4-8d26-86eb56eed6b1]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Volume volume-037a155d-a59e-407b-b7bd-66cc5509d6fb (037a155d-a59e-407b-b7bd-66cc5509d6fb): created successfully Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224edd8a-9d6e-40df-aefe-70e12894c285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Flow 'volume_create_manager' (1c65b959-b683-4d0c-b657-3175d36e3fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4db4c173-22f4-40fd-9078-de5ab28334f7 tempest-VolumeTypesAccessTest-1217468612 None] Created volume successfully. Jul 10 19:44:05 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d Jul 10 19:44:05 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:06 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d" returned: 0 in 0.807s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '057868c9-ffb5-4ac1-9fdd-f2ed7c1478ed', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:44:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-d2f38539-f6d6-4b94-8374-338f756d7b3f req-b4a726be-6d1d-4414-9888-e08f20385554 tempest-TestInstancesWithCinderVolumes-1269473727 None] attachment_update completed successfully. Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Acquiring lock "cinder-037a155d-a59e-407b-b7bd-66cc5509d6fb-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Lock "cinder-037a155d-a59e-407b-b7bd-66cc5509d6fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Acquiring lock "cinder-quobyte-037a155d-a59e-407b-b7bd-66cc5509d6fb" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Lock "cinder-quobyte-037a155d-a59e-407b-b7bd-66cc5509d6fb" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1945eb-5c0f-445b-b39c-01328586dbc0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:07 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb Jul 10 19:44:07 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:07 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb" returned: 0 in 0.829s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:07 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb Jul 10 19:44:07 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:08 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-037a155d-a59e-407b-b7bd-66cc5509d6fb" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Lock "cinder-quobyte-037a155d-a59e-407b-b7bd-66cc5509d6fb" released by "delete_volume" :: held 1.594s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:08 devstack cinder-volume[87164]: WARNING cinder.quota [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1223610539 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1223610539, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:08 devstack cinder-volume[87164]: WARNING cinder.quota [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1223610539 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1223610539, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Created reservations ['e594b718-adbd-454b-a2a9-457eddd22cc6', 'e0c61d61-7131-458b-b840-180866a4befc', '4869771f-d7c4-41fb-81db-9ad7e7539190', '33983138-bda3-41da-b4ef-ebd85c668ea7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:08 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:44:08 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:09 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:09 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:44:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Deleted volume successfully. Jul 10 19:44:09 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=96,cinder:SELECT=82,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:44:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b35d14b4-5590-4a5f-9e19-77b4f629a462 tempest-VolumeTypesAccessTest-1217468612 None] Lock "cinder-037a155d-a59e-407b-b7bd-66cc5509d6fb-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:12 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=102,cinder:SELECT=81,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:44:12 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:44:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (1d7a9540-d79e-4131-82b5-a79682d2060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18077703-2377-436b-bc17-9e2fd5290a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18077703-2377-436b-bc17-9e2fd5290a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-883863148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9706b643-7d3e-491b-9592-a2d9d38355d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:13Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e62b9ba-e6e0-47ff-a340-ad9467141d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e62b9ba-e6e0-47ff-a340-ad9467141d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394d9a01-5319-418b-a7d6-bce22bca2645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394d9a01-5319-418b-a7d6-bce22bca2645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9706b643-7d3e-491b-9592-a2d9d38355d7', 'volume_name': 'volume-9706b643-7d3e-491b-9592-a2d9d38355d7', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfda3b2-2968-4790-97d7-8041b468caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfda3b2-2968-4790-97d7-8041b468caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d577300c-ecb4-4924-ac8d-a3c4bbfa75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:13 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Volume 9706b643-7d3e-491b-9592-a2d9d38355d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9706b643-7d3e-491b-9592-a2d9d38355d7', 'volume_size': 1} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-883863148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9706b643-7d3e-491b-9592-a2d9d38355d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:13Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Creating volume 9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:44:13 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:44:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:13 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 1073741824 Jul 10 19:44:13 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:14 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 1073741824" returned: 0 in 0.966s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:14 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 Jul 10 19:44:14 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:14 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7" returned: 0 in 0.761s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d577300c-ecb4-4924-ac8d-a3c4bbfa75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9706b643-7d3e-491b-9592-a2d9d38355d7', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ce06c0-0951-4325-aae5-2961d85be6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Volume volume-9706b643-7d3e-491b-9592-a2d9d38355d7 (9706b643-7d3e-491b-9592-a2d9d38355d7): created successfully Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ce06c0-0951-4325-aae5-2961d85be6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (1d7a9540-d79e-4131-82b5-a79682d2060a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f354fd2f-7e3c-4884-8b57-b35b5e8b8ced tempest-VolumesSnapshotTestJSON-1813301148 None] Created volume successfully. Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[253d03fb-1634-4690-bf3b-055f221a513d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:15 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 Jul 10 19:44:15 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:15 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" returned: 0 in 0.958s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.977s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.480s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Creating offline snapshot fedd3b71-1b06-4123-b74f-c1aa644b7fec of volume 9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a4281-45c7-4a37-831c-4a3c5d0e0bdf]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9ca5008-7f81-429b-bf68-c003f442a18e', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:44:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-3e177ccb-7141-40df-9318-98b8233dd22d req-f685d1e4-0d8f-4790-ad7d-22bcf176ffe2 tempest-TestInstancesWithCinderVolumes-1269473727 None] attachment_update completed successfully. Jul 10 19:44:16 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 Jul 10 19:44:16 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:16 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7" returned: 0 in 0.947s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:16 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec 1G Jul 10 19:44:16 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:17 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec 1G" returned: 0 in 1.018s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9706b643-7d3e-491b-9592-a2d9d38355d7 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:17 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9706b643-7d3e-491b-9592-a2d9d38355d7 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec Jul 10 19:44:17 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:18 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9706b643-7d3e-491b-9592-a2d9d38355d7 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:18 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec is being set with open permissions: ugo+rw Jul 10 19:44:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:18 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec Jul 10 19:44:18 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:19 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec" returned: 0 in 0.768s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:19 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info Jul 10 19:44:19 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:20 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:20 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info is being set with open permissions: ugo+rw Jul 10 19:44:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:20 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info Jul 10 19:44:20 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:21 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.info" returned: 0 in 0.660s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.169s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ac0ebf4b-f536-48ff-8c19-be35f0e2829d tempest-VolumesSnapshotTestJSON-1813301148 None] Create snapshot completed successfully Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-fedd3b71-1b06-4123-b74f-c1aa644b7fec-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-fedd3b71-1b06-4123-b74f-c1aa644b7fec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-9706b643-7d3e-491b-9592-a2d9d38355d7" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-9706b643-7d3e-491b-9592-a2d9d38355d7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-fedd3b71-1b06-4123-b74f-c1aa644b7fec" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-fedd3b71-1b06-4123-b74f-c1aa644b7fec" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Deleting offline snapshot fedd3b71-1b06-4123-b74f-c1aa644b7fec of volume 9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] snapshot_file for this snap is: volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d906c-b51c-4873-abd5-01f40d9b9719]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:22 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec Jul 10 19:44:22 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:23 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec" returned: 0 in 0.891s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9706b643-7d3e-491b-9592-a2d9d38355d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:44:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d540752f-b4e0-4f4f-836d-beaa0167b053]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:23 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 Jul 10 19:44:23 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:24 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7" returned: 0 in 1.153s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:24 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec Jul 10 19:44:24 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:25 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec" returned: 0 in 0.953s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:25 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec Jul 10 19:44:25 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-4f920ae3-556e-4e7c-b045-df78360a59c1 req-f77f2110-c1f7-4beb-9dfe-e4cf23f84c6a tempest-TestInstancesWithCinderVolumes-1269473727 None] Terminate volume connection completed successfully. Jul 10 19:44:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-4f920ae3-556e-4e7c-b045-df78360a59c1 req-f77f2110-c1f7-4beb-9dfe-e4cf23f84c6a tempest-TestInstancesWithCinderVolumes-1269473727 None] Deleting attachment 057868c9-ffb5-4ac1-9fdd-f2ed7c1478ed. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:44:26 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7.fedd3b71-1b06-4123-b74f-c1aa644b7fec" returned: 0 in 0.846s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-fedd3b71-1b06-4123-b74f-c1aa644b7fec" released by "_delete_snapshot" :: held 3.996s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-9706b643-7d3e-491b-9592-a2d9d38355d7" released by "delete_snapshot" :: held 4.030s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:26 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['31361e86-9ebc-4007-bfad-2c7853e066c2', 'c75e95de-9432-4df0-a6c4-c88a5d1a52f4', '51ee0cb5-bd21-48f1-8f89-22a8242c9a53', '6ed84856-2031-4fa5-9384-54097757a132'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:44:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Delete snapshot completed successfully. Jul 10 19:44:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-da42fdef-850c-478b-b0c9-777069eb17d8 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-fedd3b71-1b06-4123-b74f-c1aa644b7fec-delete_snapshot" released by "delete_snapshot" :: held 4.336s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (9d9e421e-869c-4cc7-bd36-427c769fd993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fd4979-400a-4f89-ad85-e48bab6017a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fd4979-400a-4f89-ad85-e48bab6017a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1527692510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978727b6-f24c-4ff2-8742-cce24f9045fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:29Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12412d9d-7b2a-4044-a298-fda0c0503576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12412d9d-7b2a-4044-a298-fda0c0503576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32142009-7fa2-4506-ab97-c02f57fde559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32142009-7fa2-4506-ab97-c02f57fde559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978727b6-f24c-4ff2-8742-cce24f9045fd', 'volume_name': 'volume-978727b6-f24c-4ff2-8742-cce24f9045fd', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edce8d08-6a2a-4267-b3d8-132fe53719f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edce8d08-6a2a-4267-b3d8-132fe53719f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fd81ad-d6f8-46e0-a4f0-3c988c9da32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:28 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume 978727b6-f24c-4ff2-8742-cce24f9045fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978727b6-f24c-4ff2-8742-cce24f9045fd', 'volume_size': 1} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1527692510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978727b6-f24c-4ff2-8742-cce24f9045fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:29Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating volume 978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:44:28 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "cinder-b400b06b-8f5c-432d-825b-1bbcc0b2363d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:28 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd 1073741824 Jul 10 19:44:28 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-b400b06b-8f5c-432d-825b-1bbcc0b2363d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "cinder-quobyte-b400b06b-8f5c-432d-825b-1bbcc0b2363d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-quobyte-b400b06b-8f5c-432d-825b-1bbcc0b2363d" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0845ab5c-b5fa-4398-aff6-2a0d52398080]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:29 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d Jul 10 19:44:29 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:30 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d" returned: 0 in 1.223s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:30 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd 1073741824" returned: 0 in 1.504s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:30 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d Jul 10 19:44:30 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:30 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:44:30 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:31 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.042s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] <== create_volume: return (2641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fd81ad-d6f8-46e0-a4f0-3c988c9da32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978727b6-f24c-4ff2-8742-cce24f9045fd', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619df131-8f79-4e4d-8cb2-ffc1889831dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:31 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:31 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume volume-978727b6-f24c-4ff2-8742-cce24f9045fd (978727b6-f24c-4ff2-8742-cce24f9045fd): created successfully Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619df131-8f79-4e4d-8cb2-ffc1889831dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (9d9e421e-869c-4cc7-bd36-427c769fd993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b400b06b-8f5c-432d-825b-1bbcc0b2363d" returned: 0 in 1.254s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a70aeb8b-cd8e-4f20-8c78-ca78d43c4318 tempest-VolumesSnapshotTestJSON-1813301148 None] Created volume successfully. Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-quobyte-b400b06b-8f5c-432d-825b-1bbcc0b2363d" released by "delete_volume" :: held 2.565s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:31 devstack cinder-volume[87164]: WARNING cinder.quota [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654846786-1767484447 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654846786-1767484447, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:31 devstack cinder-volume[87164]: WARNING cinder.quota [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654846786-1767484447 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1654846786-1767484447, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Created reservations ['3261f420-c093-41b3-b36d-4fe3e65bd9bf', 'fa19905a-c7df-46ba-8a26-c1710fbc76e2', '31ad6dd3-8b76-40c4-837f-9fdcd0fce777', 'add31213-2b93-4102-a6a1-ab7ac0af05cc'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:31 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:44:31 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating offline snapshot edaa4648-b7b2-429b-8e58-0ce215bc1172 of volume 978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:44:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf8c47-dba5-4d5a-b501-6554fa12d7c6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:32 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:44:32 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:33 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.304s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:33 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:44:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deleted volume successfully. Jul 10 19:44:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b6049c83-e9c0-4703-9049-de742fdb4992 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-b400b06b-8f5c-432d-825b-1bbcc0b2363d-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:33 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.204s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:33 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 1G Jul 10 19:44:33 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-89eeb515-c0d5-4388-aeef-dd69c7b106cf req-4ff6fdf5-f1cc-4bdb-9673-6b73d85c6573 tempest-TestInstancesWithCinderVolumes-1269473727 None] Terminate volume connection completed successfully. Jul 10 19:44:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-89eeb515-c0d5-4388-aeef-dd69c7b106cf req-4ff6fdf5-f1cc-4bdb-9673-6b73d85c6573 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deleting attachment d9ca5008-7f81-429b-bf68-c003f442a18e. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:44:34 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 1G" returned: 0 in 1.193s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978727b6-f24c-4ff2-8742-cce24f9045fd -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:34 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978727b6-f24c-4ff2-8742-cce24f9045fd -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 Jul 10 19:44:34 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:35 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978727b6-f24c-4ff2-8742-cce24f9045fd -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172" returned: 0 in 0.792s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:35 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 is being set with open permissions: ugo+rw Jul 10 19:44:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:35 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 Jul 10 19:44:35 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:36 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172" returned: 0 in 0.915s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:36 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info Jul 10 19:44:36 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "cinder-b603bd3e-46ac-4dcc-9bee-28ba1096dc90-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-b603bd3e-46ac-4dcc-9bee-28ba1096dc90-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "cinder-quobyte-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-quobyte-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[41007089-7327-4339-a101-7837de021cfe]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:37 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 Jul 10 19:44:37 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:37 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info" returned: 0 in 1.097s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:37 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info is being set with open permissions: ugo+rw Jul 10 19:44:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:37 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:44:37 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:37 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info Jul 10 19:44:37 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:38 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.info" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:38 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.149s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" returned: 0 in 1.471s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:38 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90 Jul 10 19:44:38 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-43417c8e-2f89-4864-ba74-ade3c91ca268 tempest-VolumesSnapshotTestJSON-1813301148 None] Create snapshot completed successfully Jul 10 19:44:38 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.276s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:44:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:44:39 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" returned: 0 in 1.155s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (aed95c46-c2a3-4a17-bf52-e2a5b8583ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd92a244-0855-48fb-a3aa-93326342efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-quobyte-b603bd3e-46ac-4dcc-9bee-28ba1096dc90" released by "delete_volume" :: held 2.719s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd92a244-0855-48fb-a3aa-93326342efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-405649587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c39605-e6a3-4882-b3df-dbb857b2b133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:44:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=edaa4648-b7b2-429b-8e58-0ce215bc1172,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:44:40Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253588fc-d590-46da-9169-4e76083f2c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253588fc-d590-46da-9169-4e76083f2c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f355912-3128-44b0-ac28-d658cebd70bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f355912-3128-44b0-ac28-d658cebd70bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9c39605-e6a3-4882-b3df-dbb857b2b133', 'volume_name': 'volume-b9c39605-e6a3-4882-b3df-dbb857b2b133', 'volume_size': 2, 'snapshot_id': 'edaa4648-b7b2-429b-8e58-0ce215bc1172'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe125cd-d9d9-412e-9232-7ab9a9024fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe125cd-d9d9-412e-9232-7ab9a9024fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940251a5-d131-440b-8d70-244a9cd2f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume b9c39605-e6a3-4882-b3df-dbb857b2b133: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9c39605-e6a3-4882-b3df-dbb857b2b133', 'volume_size': 2, 'snapshot_id': 'edaa4648-b7b2-429b-8e58-0ce215bc1172'} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-edaa4648-b7b2-429b-8e58-0ce215bc1172-b9c39605-e6a3-4882-b3df-dbb857b2b133" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:39 devstack cinder-volume[87164]: WARNING cinder.quota [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2026525786-1178498006 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2026525786-1178498006, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:39 devstack cinder-volume[87164]: WARNING cinder.quota [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2026525786-1178498006 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2026525786-1178498006, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-edaa4648-b7b2-429b-8e58-0ce215bc1172-b9c39605-e6a3-4882-b3df-dbb857b2b133" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating volume b9c39605-e6a3-4882-b3df-dbb857b2b133 from snapshot edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-b9c39605-e6a3-4882-b3df-dbb857b2b133" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-b9c39605-e6a3-4882-b3df-dbb857b2b133" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] snapshot: edaa4648-b7b2-429b-8e58-0ce215bc1172, volume: b9c39605-e6a3-4882-b3df-dbb857b2b133, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Created reservations ['92fdb3c5-2f04-4fb9-96d4-7f4d796d9701', '3738f611-5c1c-4a3f-b943-2aee4b7c3053', 'e868e098-7944-4635-b443-0b5b1a7a3965', '5da6b9df-d29c-46d4-8315-b9d502de5168'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3d8472-3123-4552-9c4a-979cc2346676]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:40 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:44:40 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:40 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 Jul 10 19:44:40 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:41 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.117s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:44:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Deleted volume successfully. Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a27aa290-bfe2-4120-beb4-5ba52d1a1815 tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-b603bd3e-46ac-4dcc-9bee-28ba1096dc90-delete_volume" released by "delete_volume" :: held 4.341s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:41 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172" returned: 0 in 1.456s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-978727b6-f24c-4ff2-8742-cce24f9045fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[214b68a3-f047-4a98-8e27-8fa0b573866b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:41 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:44:41 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:42 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.066s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:42 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:44:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:42 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 Jul 10 19:44:42 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:49 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133" returned: 0 in 7.043s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ead53c-4011-42fe-b13a-b46abf8af9a8]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:49 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:44:49 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:49 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=38,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:44:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-70306432-9d59-4fbe-a3d9-4ff44b1d825a req-4829228e-0f55-4e59-8a90-5da1c8b83b3e tempest-TestInstancesWithCinderVolumes-1269473727 None] Terminate volume connection completed successfully. Jul 10 19:44:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-70306432-9d59-4fbe-a3d9-4ff44b1d825a req-4829228e-0f55-4e59-8a90-5da1c8b83b3e tempest-TestInstancesWithCinderVolumes-1269473727 None] Deleting attachment 1781b8d9-a32f-47f2-ba47-f6eaf9a0824a. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:44:50 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.028s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:50 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:44:50 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Converted 1024.00 MB image at 145.33 MB/s Jul 10 19:44:50 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 is being set with open permissions: ugo+rw Jul 10 19:44:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:50 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 Jul 10 19:44:50 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:51 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133" returned: 0 in 1.099s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-b9c39605-e6a3-4882-b3df-dbb857b2b133" released by "_copy_volume_from_snapshot" :: held 11.829s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-edaa4648-b7b2-429b-8e58-0ce215bc1172-b9c39605-e6a3-4882-b3df-dbb857b2b133" released by "_create_volume_from_snapshot" :: held 11.888s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.918s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940251a5-d131-440b-8d70-244a9cd2f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c39605-e6a3-4882-b3df-dbb857b2b133', 'volume_size': 2, 'snapshot_id': 'edaa4648-b7b2-429b-8e58-0ce215bc1172'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a08b969-9184-4c09-9dbf-7f095d3b3a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:44:51 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 (b9c39605-e6a3-4882-b3df-dbb857b2b133): created successfully Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a08b969-9184-4c09-9dbf-7f095d3b3a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:44:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (aed95c46-c2a3-4a17-bf52-e2a5b8583ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:44:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e373a894-bc1d-41af-87b2-97f6f058d174 tempest-VolumesSnapshotTestJSON-1813301148 None] Created volume successfully. Jul 10 19:44:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-b9c39605-e6a3-4882-b3df-dbb857b2b133-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-b9c39605-e6a3-4882-b3df-dbb857b2b133-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-b9c39605-e6a3-4882-b3df-dbb857b2b133" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-b9c39605-e6a3-4882-b3df-dbb857b2b133" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e05b11d-5708-41f0-97f6-546ff1cc82fd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:52 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 Jul 10 19:44:52 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "cinder-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:53 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133" returned: 0 in 1.327s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:53 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133 Jul 10 19:44:53 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "cinder-quobyte-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-quobyte-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" acquired by "delete_volume" :: waited 0.058s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f01f73-b5e0-469a-b4d2-753479b3d527]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:54 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:44:54 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:54 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b9c39605-e6a3-4882-b3df-dbb857b2b133" returned: 0 in 1.104s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-b9c39605-e6a3-4882-b3df-dbb857b2b133" released by "delete_volume" :: held 2.504s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['2cce62b1-d3fe-4532-9038-b83f81ad6703', 'e1d2fa3a-e620-4af0-9013-8b4e0f19ab66', '8b5f42aa-1d40-4bfb-bf8c-b1cb43999d9c', 'c0fa4df7-9586-4f2a-a599-91c312c85dcf'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:55 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:44:55 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:55 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 0 in 1.146s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:55 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:44:55 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-edaa4648-b7b2-429b-8e58-0ce215bc1172-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-edaa4648-b7b2-429b-8e58-0ce215bc1172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-978727b6-f24c-4ff2-8742-cce24f9045fd" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-978727b6-f24c-4ff2-8742-cce24f9045fd" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-edaa4648-b7b2-429b-8e58-0ce215bc1172" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-edaa4648-b7b2-429b-8e58-0ce215bc1172" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Deleting offline snapshot edaa4648-b7b2-429b-8e58-0ce215bc1172 of volume 978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] snapshot_file for this snap is: volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a030a-53a9-419c-bdc7-7afa17059d81]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:56 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 Jul 10 19:44:56 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:56 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.266s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:44:56 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Deleted volume successfully. Jul 10 19:44:56 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c389f20-6f5e-4e8f-bac4-92062370a4ae tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-b9c39605-e6a3-4882-b3df-dbb857b2b133-delete_volume" released by "delete_volume" :: held 4.125s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 1 in 1.209s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:44:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:56 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf Jul 10 19:44:56 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:57 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172" returned: 0 in 1.329s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-978727b6-f24c-4ff2-8742-cce24f9045fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b422615-6224-4351-94f1-ac38cd4b55c9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:57 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" returned: 0 in 1.108s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-quobyte-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf" released by "delete_volume" :: held 3.590s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:44:57 devstack cinder-volume[87164]: WARNING cinder.quota [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50806950-98522740 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50806950-98522740, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:57 devstack cinder-volume[87164]: WARNING cinder.quota [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50806950-98522740 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-50806950-98522740, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Created reservations ['1f17952c-fc3b-4879-904d-ec29edd7a133', 'ababbef0-6b85-4936-8e02-c22f3c585019', 'af9b0275-dae6-46d3-91ef-edddd9cd7f52', 'c468fbaf-0832-4696-9822-dab2c8afe518'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:44:57 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:44:57 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:44:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:57 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:44:57 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:58 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.284s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:44:59 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 Jul 10 19:44:59 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:44:59 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 10 19:44:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:44:59 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:44:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Deleted volume successfully. Jul 10 19:44:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ccf345dd-4460-4d8d-a140-2efa1fb1499b tempest-TestInstancesWithCinderVolumes-1269473727 None] Lock "cinder-3e86e3d7-3dd0-40a1-b56e-8e06bcb5edcf-delete_volume" released by "delete_volume" :: held 5.872s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:00 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172" returned: 0 in 1.636s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:00 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172 Jul 10 19:45:00 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:01 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd.edaa4648-b7b2-429b-8e58-0ce215bc1172" returned: 0 in 1.059s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-edaa4648-b7b2-429b-8e58-0ce215bc1172" released by "_delete_snapshot" :: held 5.522s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-978727b6-f24c-4ff2-8742-cce24f9045fd" released by "delete_snapshot" :: held 5.573s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:01 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['02e68611-48c8-4b88-95da-caf1de45ff9c', '96c82db8-3c6c-4e0b-86c8-35f9075ec72e', '140530bb-334a-43a1-b1eb-68cb53810bd5', '7845b0af-1b8e-4d9d-8f1d-dda9e34dc547'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Delete snapshot completed successfully. Jul 10 19:45:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e00e3c30-71cd-498c-9b27-d1aee8a02777 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-edaa4648-b7b2-429b-8e58-0ce215bc1172-delete_snapshot" released by "delete_snapshot" :: held 5.866s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-978727b6-f24c-4ff2-8742-cce24f9045fd-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-978727b6-f24c-4ff2-8742-cce24f9045fd-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-978727b6-f24c-4ff2-8742-cce24f9045fd" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-978727b6-f24c-4ff2-8742-cce24f9045fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5b01e-d703-4cc8-9f36-91ed37ac9258]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:03 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:45:03 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (5d363d2e-1b0c-4321-ba55-0b8aa65cb599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aa53d9-6c2c-4820-ac85-b26b9ff0547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aa53d9-6c2c-4820-ac85-b26b9ff0547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-18117332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a676baf-9072-4d05-a590-8b97747a1262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:04Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f0b814-73cf-4e1c-99c8-8654e2f1dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f0b814-73cf-4e1c-99c8-8654e2f1dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cfeb72-fd48-4c28-8411-5ec556c0ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cfeb72-fd48-4c28-8411-5ec556c0ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a676baf-9072-4d05-a590-8b97747a1262', 'volume_name': 'volume-3a676baf-9072-4d05-a590-8b97747a1262', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31675ae-59b7-46c2-9ac4-b54747288a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31675ae-59b7-46c2-9ac4-b54747288a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb0c191-6462-4922-a0d1-55f65df0efc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Volume 3a676baf-9072-4d05-a590-8b97747a1262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a676baf-9072-4d05-a590-8b97747a1262', 'volume_size': 1} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-18117332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a676baf-9072-4d05-a590-8b97747a1262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:04Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Creating volume 3a676baf-9072-4d05-a590-8b97747a1262 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:04 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:04 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 1073741824 Jul 10 19:45:04 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:04 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.511s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:04 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd Jul 10 19:45:04 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:05 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 1073741824" returned: 0 in 1.760s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:06 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-978727b6-f24c-4ff2-8742-cce24f9045fd" returned: 0 in 1.446s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-978727b6-f24c-4ff2-8742-cce24f9045fd" released by "delete_volume" :: held 3.054s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['4e97e3bd-902d-498c-8363-91a48730caed', '2e07f2f4-b696-4b4c-9055-1aa5dc1615af', 'cad50df9-df08-4122-b484-fb0c75c7a2ef', '390b476c-0ba3-46f6-9184-908e5dec3aa6'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:06 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 Jul 10 19:45:06 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:06 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:06 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:07 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262" returned: 0 in 1.301s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] <== create_volume: return (3188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.196s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb0c191-6462-4922-a0d1-55f65df0efc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a676baf-9072-4d05-a590-8b97747a1262', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735e43b8-e600-4c4f-a00c-e7cd71245495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:07 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Volume volume-3a676baf-9072-4d05-a590-8b97747a1262 (3a676baf-9072-4d05-a590-8b97747a1262): created successfully Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735e43b8-e600-4c4f-a00c-e7cd71245495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (5d363d2e-1b0c-4321-ba55-0b8aa65cb599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:07 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-135ac38d-2f6e-40ba-9f06-ba7cd9949c14 tempest-VolumesActionsTest-1504945012 None] Created volume successfully. Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (79bef7db-882e-4bce-a8b0-8940d290128a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:07 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ef72de-9163-4f52-894d-94258e18ca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.653s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ef72de-9163-4f52-894d-94258e18ca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-299280104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:08Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12e37e9-6ae2-4dab-bfdd-eff3ff51f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12e37e9-6ae2-4dab-bfdd-eff3ff51f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1698cdc6-4229-4d5f-94bf-662c3cb1a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1698cdc6-4229-4d5f-94bf-662c3cb1a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59', 'volume_name': 'volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b6cedf-07bb-4170-8c9a-648f9b9be602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b6cedf-07bb-4170-8c9a-648f9b9be602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049f6701-b872-4f0d-9ebf-4bc3992ea1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:08 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Volume 1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59', 'volume_size': 1} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-299280104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:08Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Creating volume 1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:08 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Deleted volume successfully. Jul 10 19:45:08 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 1073741824 Jul 10 19:45:08 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c16c6558-27c5-4d86-9891-42899966722a tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-978727b6-f24c-4ff2-8742-cce24f9045fd-delete_volume" released by "delete_volume" :: held 5.279s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c1630d12-ddad-4bc3-8ab8-9644f27cef18 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262" by "attach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c1630d12-ddad-4bc3-8ab8-9644f27cef18 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262" acquired by "attach_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c1630d12-ddad-4bc3-8ab8-9644f27cef18 tempest-VolumesActionsTest-1504945012 None] Attaching volume 3a676baf-9072-4d05-a590-8b97747a1262 to instance ac31b52e-aaa6-40f2-871f-0f8fe872e289 at mountpoint /dev/vdb on host None. Jul 10 19:45:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c1630d12-ddad-4bc3-8ab8-9644f27cef18 tempest-VolumesActionsTest-1504945012 None] Attach volume completed successfully. Jul 10 19:45:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c1630d12-ddad-4bc3-8ab8-9644f27cef18 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262" released by "attach_volume" :: held 0.226s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:09 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 1073741824" returned: 0 in 1.173s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:09 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:09 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-24bfe4c7-be23-4c0b-9956-4e20e2a93f98 tempest-VolumesActionsTest-1910148532 None] Terminate volume connection completed successfully. Jul 10 19:45:10 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 0.798s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049f6701-b872-4f0d-9ebf-4bc3992ea1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5f2db3-df4a-422d-9107-bcad8fcdf301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24bfe4c7-be23-4c0b-9956-4e20e2a93f98 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-detach_volume" by "detach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:10 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Volume volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 (1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59): created successfully Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5f2db3-df4a-422d-9107-bcad8fcdf301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (79bef7db-882e-4bce-a8b0-8940d290128a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24bfe4c7-be23-4c0b-9956-4e20e2a93f98 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bc22fb0b-e38e-4972-866d-f56cdb40520d tempest-VolumesSnapshotTestJSON-1813301148 None] Created volume successfully. Jul 10 19:45:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-24bfe4c7-be23-4c0b-9956-4e20e2a93f98 tempest-VolumesActionsTest-1910148532 None] Detaching volume 3a676baf-9072-4d05-a590-8b97747a1262 from instance ac31b52e-aaa6-40f2-871f-0f8fe872e289. Jul 10 19:45:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-24bfe4c7-be23-4c0b-9956-4e20e2a93f98 tempest-VolumesActionsTest-1910148532 None] Detach volume completed successfully. Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24bfe4c7-be23-4c0b-9956-4e20e2a93f98 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1116219-5570-4cab-b7be-f559310e0b58 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-detach_volume" by "detach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1116219-5570-4cab-b7be-f559310e0b58 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d1116219-5570-4cab-b7be-f559310e0b58 tempest-VolumesActionsTest-1504945012 None] Volume detach called, but volume not attached. Jul 10 19:45:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1116219-5570-4cab-b7be-f559310e0b58 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating offline snapshot 690d6c76-201a-4caa-bf81-b7e7ad6289e7 of volume 1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350fd97-29a0-4b9d-9c00-3d1a830b73bb]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:11 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:11 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "cinder-quobyte-3a676baf-9072-4d05-a590-8b97747a1262" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-quobyte-3a676baf-9072-4d05-a590-8b97747a1262" acquired by "delete_volume" :: waited 0.048s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4fcf72-aa6c-4947-a293-ea9bfde76ad3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:12 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 Jul 10 19:45:12 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:12 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 1.084s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:12 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 1G Jul 10 19:45:12 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:12 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262" returned: 0 in 1.170s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:13 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262 Jul 10 19:45:13 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:13 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 1G" returned: 0 in 1.084s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:13 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 Jul 10 19:45:13 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:13 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3a676baf-9072-4d05-a590-8b97747a1262" returned: 0 in 0.804s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-quobyte-3a676baf-9072-4d05-a590-8b97747a1262" released by "delete_volume" :: held 2.045s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=80,cinder:UPDATE=69,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Created reservations ['c4417174-c10e-4285-849a-d42f2cf61df5', '30b6b567-9057-458d-ae58-1a3b29729349', 'f5ca6540-5321-40d9-a563-0b5b5062892b', 'fd8db7aa-596b-44f6-912b-26719cded157'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:14 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:14 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:14 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7" returned: 0 in 1.062s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:14 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 is being set with open permissions: ugo+rw Jul 10 19:45:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:14 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 Jul 10 19:45:14 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:14 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.947s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:14 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Deleted volume successfully. Jul 10 19:45:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ad441992-c234-4be3-9777-573ba7ae60a5 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-3a676baf-9072-4d05-a590-8b97747a1262-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:15 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7" returned: 0 in 1.020s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:15 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info Jul 10 19:45:15 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:16 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info" returned: 0 in 1.180s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:16 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info is being set with open permissions: ugo+rw Jul 10 19:45:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:16 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info Jul 10 19:45:16 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:17 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.info" returned: 0 in 0.812s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.373s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5689c8a9-2ce1-4448-afb2-1ff8c6b7d806 tempest-VolumesSnapshotTestJSON-1813301148 None] Create snapshot completed successfully Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (16db33bd-e26d-4d81-8d20-a59c72329f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edde9f30-d349-4655-8008-cf95c10d52e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edde9f30-d349-4655-8008-cf95c10d52e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-561159681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adaf339-89a7-4b77-a393-c6ae360b82bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2514ccdf7833431abd3a0e0e9262ce7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=690d6c76-201a-4caa-bf81-b7e7ad6289e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:19Z,use_quota=True,user_id='8efc852a8dd54bee990313a7b0742cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6327af-439d-4af8-b1e9-1907eeb0ac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6327af-439d-4af8-b1e9-1907eeb0ac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc80150-71bd-41ee-ba18-6ac9d301a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc80150-71bd-41ee-ba18-6ac9d301a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4adaf339-89a7-4b77-a393-c6ae360b82bb', 'volume_name': 'volume-4adaf339-89a7-4b77-a393-c6ae360b82bb', 'volume_size': 1, 'snapshot_id': '690d6c76-201a-4caa-bf81-b7e7ad6289e7'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcd35b3-b3e1-4c83-a66c-b1b8bdcf3b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcd35b3-b3e1-4c83-a66c-b1b8bdcf3b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8896b87d-7be9-4936-90b4-e522fb4c6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:19 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume 4adaf339-89a7-4b77-a393-c6ae360b82bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4adaf339-89a7-4b77-a393-c6ae360b82bb', 'volume_size': 1, 'snapshot_id': '690d6c76-201a-4caa-bf81-b7e7ad6289e7'} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-690d6c76-201a-4caa-bf81-b7e7ad6289e7-4adaf339-89a7-4b77-a393-c6ae360b82bb" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-690d6c76-201a-4caa-bf81-b7e7ad6289e7-4adaf339-89a7-4b77-a393-c6ae360b82bb" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating volume 4adaf339-89a7-4b77-a393-c6ae360b82bb from snapshot 690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-4adaf339-89a7-4b77-a393-c6ae360b82bb" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-4adaf339-89a7-4b77-a393-c6ae360b82bb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] snapshot: 690d6c76-201a-4caa-bf81-b7e7ad6289e7, volume: 4adaf339-89a7-4b77-a393-c6ae360b82bb, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2593d-e012-4254-867a-9f40086d45d8]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:19 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 Jul 10 19:45:19 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:20 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7" returned: 0 in 0.976s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f677bb-2dcf-4c83-8319-a786a72cd4aa]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:20 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:20 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Flow 'volume_create_manager' (9fc892f4-5ec4-4143-83bd-7b7fa2c9168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f308fb-b1d3-4f37-ab29-fdbb405fe2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f308fb-b1d3-4f37-ab29-fdbb405fe2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-583547786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67db8948-0dc3-4d1f-bac6-4d9555d1d345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ba6450d964b14b03cea459bbd090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:21Z,use_quota=True,user_id='fb80e2193016486b81129c9ff5472631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd432ee-fec1-441b-a348-2594d1ea6d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd432ee-fec1-441b-a348-2594d1ea6d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fed4ff-a438-4aab-898e-3d8af6cb93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fed4ff-a438-4aab-898e-3d8af6cb93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67db8948-0dc3-4d1f-bac6-4d9555d1d345', 'volume_name': 'volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4078a233-777b-42c1-af19-ccd2f910369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4078a233-777b-42c1-af19-ccd2f910369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0029795-9c38-4d82-8a1e-2987b101db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Volume 67db8948-0dc3-4d1f-bac6-4d9555d1d345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345', 'volume_size': 1} Jul 10 19:45:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:21 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 0.864s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:21 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:45:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:21 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb Jul 10 19:45:21 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (edcc3b81-9f26-45b8-854c-9472c9932d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1e9811-a6a2-4db1-8b1b-3da60c7e9496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1e9811-a6a2-4db1-8b1b-3da60c7e9496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c075f244-6db4-448d-9072-e5ccc78fdf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:22Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eac4492-b08d-4d93-bfdf-5aa3e712173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eac4492-b08d-4d93-bfdf-5aa3e712173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf84c450-9b97-4413-8873-4a6936b0c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf84c450-9b97-4413-8873-4a6936b0c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c075f244-6db4-448d-9072-e5ccc78fdf50', 'volume_name': 'volume-c075f244-6db4-448d-9072-e5ccc78fdf50', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c067b-d04d-4171-ab4c-fb25c030a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c067b-d04d-4171-ab4c-fb25c030a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8ce01c-0533-41cb-b666-6491af3b5fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Volume c075f244-6db4-448d-9072-e5ccc78fdf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c075f244-6db4-448d-9072-e5ccc78fdf50', 'volume_size': 1} Jul 10 19:45:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:27 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb" returned: 0 in 6.201s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3c16be-d4bd-4ae8-a290-ef95da901f58]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:27 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:27 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:28 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 0.985s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:28 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:45:28 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Converted 1024.00 MB image at 165.08 MB/s Jul 10 19:45:28 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb is being set with open permissions: ugo+rw Jul 10 19:45:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:28 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb Jul 10 19:45:28 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:29 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb" returned: 0 in 0.722s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-4adaf339-89a7-4b77-a393-c6ae360b82bb" released by "_copy_volume_from_snapshot" :: held 9.871s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-690d6c76-201a-4caa-bf81-b7e7ad6289e7-4adaf339-89a7-4b77-a393-c6ae360b82bb" released by "_create_volume_from_snapshot" :: held 9.901s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.919s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.592s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-583547786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67db8948-0dc3-4d1f-bac6-4d9555d1d345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ba6450d964b14b03cea459bbd090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:21Z,use_quota=True,user_id='fb80e2193016486b81129c9ff5472631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Creating volume 67db8948-0dc3-4d1f-bac6-4d9555d1d345 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:29 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:29 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 1073741824 Jul 10 19:45:29 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8896b87d-7be9-4936-90b4-e522fb4c6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adaf339-89a7-4b77-a393-c6ae360b82bb', 'volume_size': 1, 'snapshot_id': '690d6c76-201a-4caa-bf81-b7e7ad6289e7'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347356e3-a8f7-443b-9445-b09a897a4f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Volume volume-4adaf339-89a7-4b77-a393-c6ae360b82bb (4adaf339-89a7-4b77-a393-c6ae360b82bb): created successfully Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347356e3-a8f7-443b-9445-b09a897a4f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Flow 'volume_create_manager' (16db33bd-e26d-4d81-8d20-a59c72329f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-23c42114-0921-48a4-9cc0-30c1ee02e590 tempest-VolumesSnapshotTestJSON-1813301148 None] Created volume successfully. Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-4adaf339-89a7-4b77-a393-c6ae360b82bb-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-4adaf339-89a7-4b77-a393-c6ae360b82bb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:30 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 1073741824" returned: 0 in 1.043s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-4adaf339-89a7-4b77-a393-c6ae360b82bb" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-4adaf339-89a7-4b77-a393-c6ae360b82bb" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[553b1481-642b-4c0c-b660-14ab21ef3f5d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:30 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 Jul 10 19:45:30 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:30 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb Jul 10 19:45:30 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:31 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345" returned: 0 in 0.777s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.139s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c075f244-6db4-448d-9072-e5ccc78fdf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:22Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Creating volume c075f244-6db4-448d-9072-e5ccc78fdf50 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:31 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0029795-9c38-4d82-8a1e-2987b101db01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a730ad-5e28-469f-be68-ab5f4834a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:31 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 1073741824 Jul 10 19:45:31 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:31 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Volume volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 (67db8948-0dc3-4d1f-bac6-4d9555d1d345): created successfully Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a730ad-5e28-469f-be68-ab5f4834a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Flow 'volume_create_manager' (9fc892f4-5ec4-4143-83bd-7b7fa2c9168f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-17e6932d-c09e-495e-8c5f-c83d22da39e8 tempest-AttachVolumeTestJSON-234969277 None] Created volume successfully. Jul 10 19:45:31 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb" returned: 0 in 0.951s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:31 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb Jul 10 19:45:31 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:32 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4adaf339-89a7-4b77-a393-c6ae360b82bb" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-4adaf339-89a7-4b77-a393-c6ae360b82bb" released by "delete_volume" :: held 1.862s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['8c3dd5b4-357a-4be5-916f-484b928a69d1', 'c7aa7ad4-08d3-4f60-9152-4b07c1744287', 'd8604cb9-7a1c-48c5-9042-625898b64a49', '2812e56e-9b0f-439d-8a56-de5e1785ff18'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:32 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 1073741824" returned: 0 in 1.119s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:32 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 Jul 10 19:45:32 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:32 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:32 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-690d6c76-201a-4caa-bf81-b7e7ad6289e7-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-690d6c76-201a-4caa-bf81-b7e7ad6289e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-690d6c76-201a-4caa-bf81-b7e7ad6289e7" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-690d6c76-201a-4caa-bf81-b7e7ad6289e7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Deleting offline snapshot 690d6c76-201a-4caa-bf81-b7e7ad6289e7 of volume 1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] snapshot_file for this snap is: volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c2db8-9285-4bc6-b491-ab615c704ad5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:33 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 Jul 10 19:45:33 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:33 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50" returned: 0 in 0.952s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:33 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8ce01c-0533-41cb-b666-6491af3b5fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c075f244-6db4-448d-9072-e5ccc78fdf50', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04294ca-5ed6-4dd9-81da-ec5cceaa29c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Deleted volume successfully. Jul 10 19:45:33 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Volume volume-c075f244-6db4-448d-9072-e5ccc78fdf50 (c075f244-6db4-448d-9072-e5ccc78fdf50): created successfully Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04294ca-5ed6-4dd9-81da-ec5cceaa29c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (edcc3b81-9f26-45b8-854c-9472c9932d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0f5584f0-5205-4332-943d-99fb4aa714a9 tempest-VolumesActionsTest-1504945012 None] Created volume successfully. Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-358af112-6ed7-410d-9c67-01db58c0e589 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-4adaf339-89a7-4b77-a393-c6ae360b82bb-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:33 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7" returned: 0 in 0.961s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3843f-26ef-4881-a90b-439b94baf258]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:33 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:33 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-c075f244-6db4-448d-9072-e5ccc78fdf50-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-c075f244-6db4-448d-9072-e5ccc78fdf50-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-quobyte-c075f244-6db4-448d-9072-e5ccc78fdf50" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-c075f244-6db4-448d-9072-e5ccc78fdf50" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[840209db-04d8-41d1-88eb-3ef38289d9ea]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:34 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 0.947s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:34 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 Jul 10 19:45:34 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:34 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 Jul 10 19:45:34 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a9c40-a53c-413b-8e53-7d7f83099533]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:35 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 Jul 10 19:45:35 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:35 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50" returned: 0 in 0.926s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:35 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50 Jul 10 19:45:35 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:35 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7" returned: 0 in 1.093s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:35 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7 Jul 10 19:45:35 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:36 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345" returned: 0 in 1.087s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.125s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a934b059-c5e4-469c-a78e-328b8f5159c0', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:45:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-b8f51235-419f-4527-a20d-fb0aaffb32b6 req-ab7b99c2-c9e4-4ee8-8d13-d5216cd95ed1 tempest-AttachVolumeTestJSON-234969277 None] attachment_update completed successfully. Jul 10 19:45:36 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c075f244-6db4-448d-9072-e5ccc78fdf50" returned: 0 in 0.966s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-c075f244-6db4-448d-9072-e5ccc78fdf50" released by "delete_volume" :: held 1.945s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Created reservations ['3c318a1d-036c-478d-955d-2eb0e3458c7b', '159af605-5de6-401e-ba05-e29b297856b7', 'edac1785-faed-44b7-a48a-51254cc40cd8', 'e44d96ac-f3c3-415d-a46d-d29887e64058'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:36 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59.690d6c76-201a-4caa-bf81-b7e7ad6289e7" returned: 0 in 0.994s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:36 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:36 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-690d6c76-201a-4caa-bf81-b7e7ad6289e7" released by "_delete_snapshot" :: held 4.167s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" released by "delete_snapshot" :: held 4.211s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['68000bc6-3d0e-4d56-83cb-618b096377c2', '77b87861-cbad-4074-82a4-0bd1fafee1f8', 'e5d019f5-65ee-4ceb-9c0f-d87f8a85adbf', '44a77724-750e-4d5a-bdea-22236d9f6ee8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Delete snapshot completed successfully. Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b0afa356-4c80-4504-8a28-63799fcd1f0b tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-690d6c76-201a-4caa-bf81-b7e7ad6289e7-delete_snapshot" released by "delete_snapshot" :: held 4.472s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:37 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:37 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (8459972b-6a45-420f-8d07-90d02afb0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba3f72-f05a-4887-a999-0aeb21d29bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba3f72-f05a-4887-a999-0aeb21d29bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1079833451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17fac88-00b3-4c10-982d-a7a3a47ee2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:38Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002983f6-c3df-4ec6-8e0b-416aeb0ffa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002983f6-c3df-4ec6-8e0b-416aeb0ffa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9debd22c-0569-4946-b326-7b49ddc33393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9debd22c-0569-4946-b326-7b49ddc33393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17fac88-00b3-4c10-982d-a7a3a47ee2c6', 'volume_name': 'volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3caad39f-04ab-47e8-931b-d40382f743d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3caad39f-04ab-47e8-931b-d40382f743d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38665d1a-bb0f-4a1b-a145-0018d45d555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:37 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Volume a17fac88-00b3-4c10-982d-a7a3a47ee2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6', 'volume_size': 1} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1079833451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17fac88-00b3-4c10-982d-a7a3a47ee2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:38Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Creating volume a17fac88-00b3-4c10-982d-a7a3a47ee2c6 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:38 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:38 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 1073741824 Jul 10 19:45:38 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:38 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.270s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Deleted volume successfully. Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d431b5ba-7cd6-46f6-bfad-661bee508b11 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-c075f244-6db4-448d-9072-e5ccc78fdf50-delete_volume" released by "delete_volume" :: held 3.641s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40a7c8-858b-4de5-90c4-bbcfe9016d6c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:38 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:38 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:38 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.285s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:45:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:45:39 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 1073741824" returned: 0 in 1.378s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:39 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 Jul 10 19:45:39 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:39 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 1.055s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:39 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59 Jul 10 19:45:39 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:40 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38665d1a-bb0f-4a1b-a145-0018d45d555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46711c5c-9fae-46bc-b406-943a6064ee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:40 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Volume volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 (a17fac88-00b3-4c10-982d-a7a3a47ee2c6): created successfully Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46711c5c-9fae-46bc-b406-943a6064ee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (8459972b-6a45-420f-8d07-90d02afb0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5689ba5e-266e-422c-a987-9a4bad22cb95 tempest-VolumesActionsTest-1504945012 None] Created volume successfully. Jul 10 19:45:40 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59" released by "delete_volume" :: held 1.992s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['c0477433-3655-4449-a69a-2eee6f64189c', '8b514c40-8eeb-4af0-a82f-ad5b5726dff1', 'd87678a1-27dd-42fc-966b-b0db8bcf56b0', 'd85b1bf3-75bf-4052-9013-dd0987025dc7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:40 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:40 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-9706b643-7d3e-491b-9592-a2d9d38355d7-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-9706b643-7d3e-491b-9592-a2d9d38355d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "cinder-quobyte-9706b643-7d3e-491b-9592-a2d9d38355d7" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-9706b643-7d3e-491b-9592-a2d9d38355d7" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c309de-f0ce-42da-9c84-475bf7f592ec]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:41 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 Jul 10 19:45:41 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-a17fac88-00b3-4c10-982d-a7a3a47ee2c6-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-a17fac88-00b3-4c10-982d-a7a3a47ee2c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-quobyte-a17fac88-00b3-4c10-982d-a7a3a47ee2c6" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-a17fac88-00b3-4c10-982d-a7a3a47ee2c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec7036-4208-4c75-aef6-7b94f103006e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:41 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.909s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Deleted volume successfully. Jul 10 19:45:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31cf34a5-6448-4bed-abf8-9dc9e9b5e8f2 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-1d88067b-3cbc-4a32-b9ef-cb9a9ee28b59-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:41 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 Jul 10 19:45:41 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:42 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7" returned: 0 in 1.310s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:42 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7 Jul 10 19:45:42 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:42 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6" returned: 0 in 1.118s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:42 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6 Jul 10 19:45:42 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Flow 'volume_create_manager' (65770251-533b-47de-b5fb-b77de7b6e2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98efa2b7-f58f-4d92-88d5-4123eb145077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98efa2b7-f58f-4d92-88d5-4123eb145077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1922660066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbe2534-8651-418d-bd49-52de4da9ea2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ba6450d964b14b03cea459bbd090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:43Z,use_quota=True,user_id='fb80e2193016486b81129c9ff5472631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe15d68-a639-4601-8e4f-88cd62d5e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe15d68-a639-4601-8e4f-88cd62d5e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157397cc-cdc3-4d67-b27a-3782e0aadde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157397cc-cdc3-4d67-b27a-3782e0aadde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efbe2534-8651-418d-bd49-52de4da9ea2e', 'volume_name': 'volume-efbe2534-8651-418d-bd49-52de4da9ea2e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a57ea4-7a7e-4ba2-bf88-9561f2121f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a57ea4-7a7e-4ba2-bf88-9561f2121f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b627e16d-f9df-4b84-aa82-059f7f5a1c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:42 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Volume efbe2534-8651-418d-bd49-52de4da9ea2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efbe2534-8651-418d-bd49-52de4da9ea2e', 'volume_size': 1} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1922660066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbe2534-8651-418d-bd49-52de4da9ea2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ba6450d964b14b03cea459bbd090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:43Z,use_quota=True,user_id='fb80e2193016486b81129c9ff5472631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Creating volume efbe2534-8651-418d-bd49-52de4da9ea2e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:42 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:42 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e 1073741824 Jul 10 19:45:42 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:43 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9706b643-7d3e-491b-9592-a2d9d38355d7" returned: 0 in 0.907s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-quobyte-9706b643-7d3e-491b-9592-a2d9d38355d7" released by "delete_volume" :: held 2.328s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Created reservations ['623373b9-0bbc-47b4-8d82-27e8b2d26c99', 'd7504efe-2a96-4a2c-92d5-01b52feef639', '2e99fac9-c436-4b62-bd5b-1ce7a3126e8a', '9f16dd44-0006-4293-befd-e05cee726dfe'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:43 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a17fac88-00b3-4c10-982d-a7a3a47ee2c6" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:43 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:43 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-a17fac88-00b3-4c10-982d-a7a3a47ee2c6" released by "delete_volume" :: held 2.018s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Created reservations ['7854393c-6325-43bf-9095-26e4bc642818', '1a67f52d-b608-4929-af86-581e536b3b2a', '3454813e-6fc8-4765-a28f-987fe8e72fe6', 'dc097835-8dd9-4f77-bf4a-f672a9e6cb4d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:43 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:43 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:43 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e 1073741824" returned: 0 in 1.115s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:43 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e Jul 10 19:45:43 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:44 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.775s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Deleted volume successfully. Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e4d51940-b75c-4f97-98b2-8afc9fc04354 tempest-VolumesSnapshotTestJSON-1813301148 None] Lock "cinder-9706b643-7d3e-491b-9592-a2d9d38355d7-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:44 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.877s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Deleted volume successfully. Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cafd4d18-6fb2-4367-9041-f6f688a124b8 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-a17fac88-00b3-4c10-982d-a7a3a47ee2c6-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:44 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b627e16d-f9df-4b84-aa82-059f7f5a1c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efbe2534-8651-418d-bd49-52de4da9ea2e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d38f54f-6a37-44dd-86e0-6943bf4ac038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:44 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Volume volume-efbe2534-8651-418d-bd49-52de4da9ea2e (efbe2534-8651-418d-bd49-52de4da9ea2e): created successfully Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d38f54f-6a37-44dd-86e0-6943bf4ac038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Flow 'volume_create_manager' (65770251-533b-47de-b5fb-b77de7b6e2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a00aa5b1-67cd-40c5-89c5-536b4e22e74a tempest-AttachVolumeTestJSON-234969277 None] Created volume successfully. Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (1936e6ed-3458-41ff-acc3-a7f39b71bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d3deae-3a90-4749-9a09-804bd775f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d3deae-3a90-4749-9a09-804bd775f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-581965863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5d146d-200b-4ce1-8119-f658edb1d1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:45Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191428b6-a027-49ee-9de1-3154105a45bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191428b6-a027-49ee-9de1-3154105a45bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12857a04-7a04-43c9-a3ff-68edab023649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12857a04-7a04-43c9-a3ff-68edab023649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5d146d-200b-4ce1-8119-f658edb1d1b3', 'volume_name': 'volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b632a12-2c53-479c-aeb2-20d0494a7f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b632a12-2c53-479c-aeb2-20d0494a7f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123762cd-00e7-4bae-bddf-bc96643173f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:45 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Volume ab5d146d-200b-4ce1-8119-f658edb1d1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3', 'volume_size': 1} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-581965863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5d146d-200b-4ce1-8119-f658edb1d1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:45Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Creating volume ab5d146d-200b-4ce1-8119-f658edb1d1b3 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:45 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:45 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 1073741824 Jul 10 19:45:45 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:46 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 1073741824" returned: 0 in 1.106s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:46 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 Jul 10 19:45:46 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:47 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3" returned: 0 in 0.741s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123762cd-00e7-4bae-bddf-bc96643173f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf20069-292a-41ff-9f2c-7f88807eee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Volume volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 (ab5d146d-200b-4ce1-8119-f658edb1d1b3): created successfully Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf20069-292a-41ff-9f2c-7f88807eee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (1936e6ed-3458-41ff-acc3-a7f39b71bf85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cfc3f881-f087-4bc1-a846-cb05135c11b6 tempest-VolumesActionsTest-1504945012 None] Created volume successfully. Jul 10 19:45:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-ab5d146d-200b-4ce1-8119-f658edb1d1b3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-ab5d146d-200b-4ce1-8119-f658edb1d1b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-quobyte-ab5d146d-200b-4ce1-8119-f658edb1d1b3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-ab5d146d-200b-4ce1-8119-f658edb1d1b3" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05306b-862b-475d-8c48-100e0a5d93ba]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:48 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 Jul 10 19:45:48 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec72dc02-ccc6-48b9-b51b-d11b6d649bae]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:49 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e Jul 10 19:45:49 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:49 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3" returned: 0 in 0.924s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:49 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3 Jul 10 19:45:49 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:49 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e" returned: 0 in 0.844s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-efbe2534-8651-418d-bd49-52de4da9ea2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d30474f-befb-42a7-a619-2809e7bca13a', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=104,cinder:UPDATE=115,cinder:DELETE=9,cinder:INSERT=29 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:45:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-c2ce3f14-c76b-4f4c-95a8-355c21ff6507 req-a2f26f11-49a3-4914-a21b-f799da1a32e8 tempest-AttachVolumeTestJSON-234969277 None] attachment_update completed successfully. Jul 10 19:45:50 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ab5d146d-200b-4ce1-8119-f658edb1d1b3" returned: 0 in 0.794s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-ab5d146d-200b-4ce1-8119-f658edb1d1b3" released by "delete_volume" :: held 1.772s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Created reservations ['f97fc8d6-9234-40aa-b65c-7ad46efe14f6', '3d67b9f2-2155-4a55-8851-5ed76aa52226', '22b83124-ee31-459c-b33f-990ace86e0c3', '9bcbf790-e102-4434-b086-6fc3d74b90b5'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:50 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:50 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:51 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.868s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Deleted volume successfully. Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (4a2488ab-399f-4d98-a7ec-0c22fb832327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1efdfcd-876a-4121-b5fe-cbff77390362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c63c9194-39dd-45a0-b9e1-8da64d965005 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-ab5d146d-200b-4ce1-8119-f658edb1d1b3-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1efdfcd-876a-4121-b5fe-cbff77390362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480711110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5606ee4a-5a2c-46e9-ada7-09940693c55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:51Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6a77c7-f54b-4fb2-b5dc-64fa1de9cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6a77c7-f54b-4fb2-b5dc-64fa1de9cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8747172f-3604-45ea-ae4b-cd26757cb5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8747172f-3604-45ea-ae4b-cd26757cb5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5606ee4a-5a2c-46e9-ada7-09940693c55b', 'volume_name': 'volume-5606ee4a-5a2c-46e9-ada7-09940693c55b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3084ca9c-25a0-432d-9fc2-e95f3c3b5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3084ca9c-25a0-432d-9fc2-e95f3c3b5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b52dc3e-019b-42a3-a547-6f75fafcf19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:51 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Volume 5606ee4a-5a2c-46e9-ada7-09940693c55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5606ee4a-5a2c-46e9-ada7-09940693c55b', 'volume_size': 1} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480711110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5606ee4a-5a2c-46e9-ada7-09940693c55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:51Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Creating volume 5606ee4a-5a2c-46e9-ada7-09940693c55b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:51 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:51 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b 1073741824 Jul 10 19:45:51 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:52 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b 1073741824" returned: 0 in 1.051s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:52 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b Jul 10 19:45:52 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:53 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b" returned: 0 in 0.785s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b52dc3e-019b-42a3-a547-6f75fafcf19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5606ee4a-5a2c-46e9-ada7-09940693c55b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bc1696-7373-4b88-933f-77d687b65a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:53 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Volume volume-5606ee4a-5a2c-46e9-ada7-09940693c55b (5606ee4a-5a2c-46e9-ada7-09940693c55b): created successfully Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bc1696-7373-4b88-933f-77d687b65a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (4a2488ab-399f-4d98-a7ec-0c22fb832327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:53 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bda374a6-80f6-4501-a7ae-62567d543ef5 tempest-VolumesActionsTest-1504945012 None] Created volume successfully. Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Flow 'volume_create_manager' (4e0ee481-4f11-4852-a6f5-f10a4e854941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3143c-6cca-4d2f-9d89-ed1334f1e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3143c-6cca-4d2f-9d89-ed1334f1e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63238333-2350-4ba4-9c81-3dbcc345b783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f68f3bffd784376bde21522bfc818a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:54Z,use_quota=True,user_id='b19b6fa637ae49c693f2a5e914d801d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cd91a2-20f0-41cb-bb4b-20476564f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cd91a2-20f0-41cb-bb4b-20476564f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949080e5-76da-432f-8b4b-27ec698bab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:53 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949080e5-76da-432f-8b4b-27ec698bab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63238333-2350-4ba4-9c81-3dbcc345b783', 'volume_name': 'volume-63238333-2350-4ba4-9c81-3dbcc345b783', 'volume_size': 1, 'image_id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4418cd5064b58f3ff681b01770ab0a52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f68f3bffd784376bde21522bfc818a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c71550c1d75eb1d50aa97d8d8f25a0d976a31b3d395bc14034b4e794dacb659cd8d5d8a3e4e92bf0578333dfb5d96f44bf5185abbd375bae8e9477e7f871844', 'id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'created_at': datetime.datetime(2026, 7, 10, 17, 45, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 45, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5/file', 'properties': {}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7059aa-3c6c-4556-b1f9-ffd0632bc483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7059aa-3c6c-4556-b1f9-ffd0632bc483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272e5497-de60-4799-b053-81ba1158775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Volume 63238333-2350-4ba4-9c81-3dbcc345b783: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63238333-2350-4ba4-9c81-3dbcc345b783', 'volume_size': 1, 'image_id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4418cd5064b58f3ff681b01770ab0a52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f68f3bffd784376bde21522bfc818a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c71550c1d75eb1d50aa97d8d8f25a0d976a31b3d395bc14034b4e794dacb659cd8d5d8a3e4e92bf0578333dfb5d96f44bf5185abbd375bae8e9477e7f871844', 'id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'created_at': datetime.datetime(2026, 7, 10, 17, 45, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 45, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5/file', 'properties': {}}, 'image_service': } Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Trying to clone 63238333-2350-4ba4-9c81-3dbcc345b783 from image e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:45:54 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Image download 0.00 MB at 0.00 MB/s Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7047145d-9446-4291-a4a9-f8924a4e4f0a]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:54 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD Jul 10 19:45:54 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-5606ee4a-5a2c-46e9-ada7-09940693c55b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-5606ee4a-5a2c-46e9-ada7-09940693c55b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "cinder-quobyte-5606ee4a-5a2c-46e9-ada7-09940693c55b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-5606ee4a-5a2c-46e9-ada7-09940693c55b" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112beee-d46a-4a13-a1c0-3bafac66adb6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:55 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b Jul 10 19:45:55 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:55 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD" returned: 0 in 0.841s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:55 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD Jul 10 19:45:55 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:55 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:55 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b Jul 10 19:45:55 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:56 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD" returned: 1 in 0.801s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Temporary image e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 is fetched for user b19b6fa637ae49c693f2a5e914d801d5. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4b54e-5e27-46f7-8e3c-837b31f05759]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:56 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD Jul 10 19:45:56 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:56 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5606ee4a-5a2c-46e9-ada7-09940693c55b" returned: 0 in 0.662s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-quobyte-5606ee4a-5a2c-46e9-ada7-09940693c55b" released by "delete_volume" :: held 1.535s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Created reservations ['1eecd2c8-3936-4025-b926-3cf25e308b5b', 'a20f1c74-23f3-4e27-ac2e-0ba4cdc1ea44', '0a8a0009-9620-4f18-b29e-4b82484b3ae9', '6adf937c-9f4b-455b-ad16-57775feab83f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:56 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:45:56 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-ee146be9-79bd-4bcb-9924-11604a50c75b req-5eb7c798-1f9e-4441-80b2-b3ca7d26b467 tempest-AttachVolumeTestJSON-234969277 None] Terminate volume connection completed successfully. Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ee146be9-79bd-4bcb-9924-11604a50c75b req-5eb7c798-1f9e-4441-80b2-b3ca7d26b467 tempest-AttachVolumeTestJSON-234969277 None] Deleting attachment a934b059-c5e4-469c-a78e-328b8f5159c0. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:45:57 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD" returned: 0 in 0.858s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:57 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD Jul 10 19:45:57 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:57 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.760s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:45:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Deleted volume successfully. Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9080b8a-2a1c-434b-abae-f10924530cb3 tempest-VolumesActionsTest-1910148532 None] Lock "cinder-5606ee4a-5a2c-46e9-ada7-09940693c55b-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (6774272f-a062-457e-957e-0fa22175727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3487a6bc-cac7-4fc1-83df-d21e25b20c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3487a6bc-cac7-4fc1-83df-d21e25b20c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173389872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e561ccc-3db9-47c8-ae50-737d2e4d4d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:58Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e645e0-5a33-47da-b86e-c399f3b47005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e645e0-5a33-47da-b86e-c399f3b47005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee937bd4-0403-4461-85f0-4eb60f655433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee937bd4-0403-4461-85f0-4eb60f655433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e561ccc-3db9-47c8-ae50-737d2e4d4d43', 'volume_name': 'volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c21bc3a-4de3-4336-bfd6-6c8a5b5bf519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c21bc3a-4de3-4336-bfd6-6c8a5b5bf519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dc4029-a218-4e79-8a27-f5b4e77be8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:57 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Volume 2e561ccc-3db9-47c8-ae50-737d2e4d4d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43', 'volume_size': 1} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173389872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e561ccc-3db9-47c8-ae50-737d2e4d4d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3341f2f4a9754deea526d19c593411c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:58Z,use_quota=True,user_id='cec24ee26e854ad9bbcca57855741344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Creating volume 2e561ccc-3db9-47c8-ae50-737d2e4d4d43 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:57 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:57 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 1073741824 Jul 10 19:45:57 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:58 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD" returned: 1 in 1.060s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:45:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:58 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 1073741824" returned: 0 in 1.290s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:59 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 Jul 10 19:45:59 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:59 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43" returned: 0 in 0.684s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63238333-2350-4ba4-9c81-3dbcc345b783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f68f3bffd784376bde21522bfc818a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:45:54Z,use_quota=True,user_id='b19b6fa637ae49c693f2a5e914d801d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Creating volume 63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:45:59 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:45:59 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 1073741824 Jul 10 19:45:59 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dc4029-a218-4e79-8a27-f5b4e77be8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e9e32e-f249-4766-b9a0-bd4a2314d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:45:59 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Volume volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 (2e561ccc-3db9-47c8-ae50-737d2e4d4d43): created successfully Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e9e32e-f249-4766-b9a0-bd4a2314d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Flow 'volume_create_manager' (6774272f-a062-457e-957e-0fa22175727c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:45:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-10da1d5e-26b7-476b-9da4-d1b1284937df tempest-VolumesActionsTest-1504945012 None] Created volume successfully. Jul 10 19:45:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-8b137fc7-1067-471d-9c34-3157b922329b req-512e665a-136c-4c81-b2cc-553af20f8c0a tempest-AttachVolumeTestJSON-234969277 None] Terminate volume connection completed successfully. Jul 10 19:45:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-8b137fc7-1067-471d-9c34-3157b922329b req-512e665a-136c-4c81-b2cc-553af20f8c0a tempest-AttachVolumeTestJSON-234969277 None] Deleting attachment 8d30474f-befb-42a7-a619-2809e7bca13a. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:46:00 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 1073741824" returned: 0 in 0.993s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:00 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:00 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "cinder-2e561ccc-3db9-47c8-ae50-737d2e4d4d43-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:01 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 0 in 0.932s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-2e561ccc-3db9-47c8-ae50-737d2e4d4d43-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Attempting download of e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'metadata': {}}])) to volume 63238333-2350-4ba4-9c81-3dbcc345b783. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "cinder-quobyte-2e561ccc-3db9-47c8-ae50-737d2e4d4d43" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-quobyte-2e561ccc-3db9-47c8-ae50-737d2e4d4d43" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec816cf0-c923-4d37-9714-f215bd636734]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd89160-5289-4572-b760-f99a5c95d03d]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:01 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 Jul 10 19:46:01 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:01 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0 Jul 10 19:46:01 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:02 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0" returned: 0 in 1.022s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:03 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43" returned: 0 in 1.244s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:03 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0 Jul 10 19:46:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:03 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:03 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43 Jul 10 19:46:03 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:03 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0" returned: 1 in 1.096s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_gcyn7cw0' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:46:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c353c77f-12bf-41df-93f0-e74f1c141f7a]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:04 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2e561ccc-3db9-47c8-ae50-737d2e4d4d43" returned: 0 in 1.008s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-quobyte-2e561ccc-3db9-47c8-ae50-737d2e4d4d43" released by "delete_volume" :: held 2.309s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:04 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD Jul 10 19:46:04 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Created reservations ['d09b570f-968d-4f26-84c2-ae02c60b1fca', '1cf6f94d-60ca-4225-925c-ba57bd17c63c', '35000770-9d31-40d0-994e-c229e90cd19e', 'f200e323-bb20-482b-ab36-dffe7cfa50de'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:04 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:04 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:05 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD" returned: 0 in 1.444s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:05 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.179s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:05 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Deleted volume successfully. Jul 10 19:46:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f0785d5-ba48-4076-bbfb-4fbce7769109 tempest-VolumesActionsTest-1504945012 None] Lock "cinder-2e561ccc-3db9-47c8-ae50-737d2e4d4d43-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:05 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD Jul 10 19:46:05 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:06 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD" returned: 1 in 1.268s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:46:06 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 was raw, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:46:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:06 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:06 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:07 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 0 in 0.939s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:07 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7cbdef0-0d3b-4678-9714-aa2453e0f2c5_1ja3yw86devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:46:07 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 19:46:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:07 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 1G Jul 10 19:46:07 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:08 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 1G" returned: 0 in 0.753s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:08 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8973fd18-9e1d-4111-a530-90ffb05acea0]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:08 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:08 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:09 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 0 in 1.036s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:09 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:09 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:10 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 1 in 0.981s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Downloaded image e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'metadata': {}}])) to volume 63238333-2350-4ba4-9c81-3dbcc345b783 successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Temporary image e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 for user b19b6fa637ae49c693f2a5e914d801d5 is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Marking volume 63238333-2350-4ba4-9c81-3dbcc345b783 as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Copying metadata from image e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 to 63238333-2350-4ba4-9c81-3dbcc345b783. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Creating volume glance metadata for volume 63238333-2350-4ba4-9c81-3dbcc345b783 backed by image e7cbdef0-0d3b-4678-9714-aa2453e0f2c5 with: {'image_id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4418cd5064b58f3ff681b01770ab0a52', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272e5497-de60-4799-b053-81ba1158775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63238333-2350-4ba4-9c81-3dbcc345b783', 'volume_size': 1, 'image_id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4418cd5064b58f3ff681b01770ab0a52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f68f3bffd784376bde21522bfc818a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c71550c1d75eb1d50aa97d8d8f25a0d976a31b3d395bc14034b4e794dacb659cd8d5d8a3e4e92bf0578333dfb5d96f44bf5185abbd375bae8e9477e7f871844', 'id': 'e7cbdef0-0d3b-4678-9714-aa2453e0f2c5', 'created_at': datetime.datetime(2026, 7, 10, 17, 45, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 45, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7cbdef0-0d3b-4678-9714-aa2453e0f2c5/file', 'properties': {}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd5519f-1604-4654-81ab-30a7f67614ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:10 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Volume volume-63238333-2350-4ba4-9c81-3dbcc345b783 (63238333-2350-4ba4-9c81-3dbcc345b783): created successfully Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd5519f-1604-4654-81ab-30a7f67614ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Flow 'volume_create_manager' (4e0ee481-4f11-4852-a6f5-f10a4e854941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-81fbbd8b-e9ee-4d89-8337-255a79aa8a95 tempest-VolumeImageDependencyTests-1482810770 None] Created volume successfully. Jul 10 19:46:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Acquiring lock "cinder-63238333-2350-4ba4-9c81-3dbcc345b783-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Lock "cinder-63238333-2350-4ba4-9c81-3dbcc345b783-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Acquiring lock "cinder-quobyte-63238333-2350-4ba4-9c81-3dbcc345b783" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Lock "cinder-quobyte-63238333-2350-4ba4-9c81-3dbcc345b783" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9fee5-c634-4594-ba93-642c8fd52dbd]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:11 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:11 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "cinder-efbe2534-8651-418d-bd49-52de4da9ea2e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-efbe2534-8651-418d-bd49-52de4da9ea2e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "cinder-quobyte-efbe2534-8651-418d-bd49-52de4da9ea2e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-quobyte-efbe2534-8651-418d-bd49-52de4da9ea2e" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1044dc-6bf9-4c60-8a26-10ed4a27a2f4]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:12 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e Jul 10 19:46:12 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:12 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 0 in 1.095s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:12 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:12 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:13 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e" returned: 0 in 1.023s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:13 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e Jul 10 19:46:13 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:13 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 1 in 1.031s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:46:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:13 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783 Jul 10 19:46:13 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:14 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-efbe2534-8651-418d-bd49-52de4da9ea2e" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-quobyte-efbe2534-8651-418d-bd49-52de4da9ea2e" released by "delete_volume" :: held 1.833s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:INSERT=25,cinder:UPDATE=114,cinder:SELECT=83,cinder:DELETE=11 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Created reservations ['2e884f06-cec6-4e53-a384-b798b62887b5', '729f281a-50f2-407f-ad87-5a77fa69f66b', 'e9d40261-a42c-4671-9c4e-4cbbd9cdf77c', '5e10102e-03ac-4555-b9de-2d1dbf025fba'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:14 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-63238333-2350-4ba4-9c81-3dbcc345b783" returned: 0 in 0.700s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Lock "cinder-quobyte-63238333-2350-4ba4-9c81-3dbcc345b783" released by "delete_volume" :: held 2.925s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:14 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:14 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Created reservations ['a3d2160d-89c9-46c0-af58-ee5650850f87', '32e5ff8b-f0ea-44f0-8603-57c0788a6f43', 'ef80d878-7d00-436f-ae6d-05fa84191d61', 'c56c9f1a-5a57-492b-9751-ddb6c8372a7d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "cinder-67db8948-0dc3-4d1f-bac6-4d9555d1d345-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-67db8948-0dc3-4d1f-bac6-4d9555d1d345-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:14 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:14 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "cinder-quobyte-67db8948-0dc3-4d1f-bac6-4d9555d1d345" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-quobyte-67db8948-0dc3-4d1f-bac6-4d9555d1d345" acquired by "delete_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d10bec6-aa68-4aab-88c0-646acc508e67]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:14 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 Jul 10 19:46:14 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:15 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.927s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Deleted volume successfully. Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4a74b77b-03cd-4f74-8f08-ac3c72be4fb1 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-efbe2534-8651-418d-bd49-52de4da9ea2e-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:15 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.946s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Deleted volume successfully. Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-082b11b7-d225-49c8-a6ee-25e3db6fa0b4 tempest-VolumeImageDependencyTests-1482810770 None] Lock "cinder-63238333-2350-4ba4-9c81-3dbcc345b783-delete_volume" released by "delete_volume" :: held 4.243s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:15 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345" returned: 0 in 1.092s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:15 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345 Jul 10 19:46:15 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:16 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-67db8948-0dc3-4d1f-bac6-4d9555d1d345" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-quobyte-67db8948-0dc3-4d1f-bac6-4d9555d1d345" released by "delete_volume" :: held 1.861s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Created reservations ['2c235f7b-33f8-4e6c-8e31-77facf9d8977', '8087d14e-35d1-418f-ad6b-f2dc061bcb5a', '74f6b4ce-a300-4bbd-9d8b-9ccb507ee4fd', '332ec35f-3b6c-467f-8c93-0d2c7ed9b572'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:16 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:16 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "cinder-b412110e-8ce8-479a-97a6-978445359b20-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-b412110e-8ce8-479a-97a6-978445359b20-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "cinder-quobyte-b412110e-8ce8-479a-97a6-978445359b20" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-quobyte-b412110e-8ce8-479a-97a6-978445359b20" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5800cc-e845-4faf-87bf-73f5157df9ee]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:17 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 Jul 10 19:46:17 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:17 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Deleted volume successfully. Jul 10 19:46:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12cd9b83-0cf4-4c59-9b55-21cdc28bc9b6 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-67db8948-0dc3-4d1f-bac6-4d9555d1d345-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:18 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:18 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20 Jul 10 19:46:18 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:18 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b412110e-8ce8-479a-97a6-978445359b20" returned: 0 in 0.658s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-quobyte-b412110e-8ce8-479a-97a6-978445359b20" released by "delete_volume" :: held 1.557s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Created reservations ['572303ea-8b1c-4d88-81f6-c0343ccd4a20', '37f33a4a-ac39-442d-be8f-f80111b22fe9', 'baa4b78c-2ec8-41ce-a247-13a207371fd1', 'd2309b3c-3956-4974-89e4-cc643ce337f0'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:18 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:18 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:19 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.661s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:19 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:19 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Deleted volume successfully. Jul 10 19:46:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-31b66c88-a7ae-4970-a5b5-e54b6f7b33f8 tempest-AttachVolumeTestJSON-234969277 None] Lock "cinder-b412110e-8ce8-479a-97a6-978445359b20-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Flow 'volume_create_manager' (836e1bc3-9e3a-4ba1-a639-ff3d1e624c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051d17d2-73dc-41ae-b7aa-526bb12e7793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051d17d2-73dc-41ae-b7aa-526bb12e7793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-15127944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82970e79e3b34f988093060d614abe6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:46:24Z,use_quota=True,user_id='29db9512064145b7bc2afa458c28afa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918ad1f-6d54-48b1-8ad3-39c8425e4ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b918ad1f-6d54-48b1-8ad3-39c8425e4ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d13ee4-8db5-4c54-aaa4-00793abaabfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d13ee4-8db5-4c54-aaa4-00793abaabfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb', 'volume_name': 'volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1448c7f9-3d1f-4aaf-b2f3-1da4bf167bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1448c7f9-3d1f-4aaf-b2f3-1da4bf167bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39a9021-bade-40b4-b708-52a776bfe464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Volume af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb', 'volume_size': 1} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-15127944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82970e79e3b34f988093060d614abe6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:46:24Z,use_quota=True,user_id='29db9512064145b7bc2afa458c28afa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Creating volume af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:46:24 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:24 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb 1073741824 Jul 10 19:46:24 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:24 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb 1073741824" returned: 0 in 0.902s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:25 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb Jul 10 19:46:25 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Flow 'volume_create_manager' (586ee7e6-2d87-4607-aded-3ff4cad4f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aff0f2-caf8-470f-a844-2977b959ba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aff0f2-caf8-470f-a844-2977b959ba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-55811020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b550f2-a465-4e51-a44e-709068e5bd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b9ff214c1049f8ab79a077fd906351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:46:25Z,use_quota=True,user_id='0f8c3375a10944b49b03cf7abb327588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9d65ff-ebe0-487f-b820-d50f1794232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9d65ff-ebe0-487f-b820-d50f1794232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445607c8-d890-496b-b242-4d907bbc4f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445607c8-d890-496b-b242-4d907bbc4f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b550f2-a465-4e51-a44e-709068e5bd98', 'volume_name': 'volume-43b550f2-a465-4e51-a44e-709068e5bd98', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495ea866-6d77-440c-b048-b3e6cbd95706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495ea866-6d77-440c-b048-b3e6cbd95706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3928d2f5-38d0-4874-9430-561b293461a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Volume 43b550f2-a465-4e51-a44e-709068e5bd98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b550f2-a465-4e51-a44e-709068e5bd98', 'volume_size': 1} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:25 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb" returned: 0 in 0.702s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-55811020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b550f2-a465-4e51-a44e-709068e5bd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b9ff214c1049f8ab79a077fd906351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:46:25Z,use_quota=True,user_id='0f8c3375a10944b49b03cf7abb327588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Creating volume 43b550f2-a465-4e51-a44e-709068e5bd98 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:46:25 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39a9021-bade-40b4-b708-52a776bfe464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:25 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 1073741824 Jul 10 19:46:25 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb93d4b-191a-46c3-89a5-e13b29415f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Volume volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb (af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb): created successfully Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb93d4b-191a-46c3-89a5-e13b29415f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Flow 'volume_create_manager' (836e1bc3-9e3a-4ba1-a639-ff3d1e624c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-df2944bc-2a9b-42f0-969d-199735786c68 tempest-VolumesMetadataTest-700940805 None] Created volume successfully. Jul 10 19:46:26 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 1073741824" returned: 0 in 0.992s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:26 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 Jul 10 19:46:26 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Acquiring lock "cinder-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Lock "cinder-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Acquiring lock "cinder-quobyte-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Lock "cinder-quobyte-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb" acquired by "delete_volume" :: waited 0.039s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce4999-1e9a-4cdb-84a6-dd2811f796e0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:27 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb Jul 10 19:46:27 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:27 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3928d2f5-38d0-4874-9430-561b293461a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b550f2-a465-4e51-a44e-709068e5bd98', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b65dce-dd22-4ee1-b55a-9abab92f91cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Volume volume-43b550f2-a465-4e51-a44e-709068e5bd98 (43b550f2-a465-4e51-a44e-709068e5bd98): created successfully Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b65dce-dd22-4ee1-b55a-9abab92f91cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Flow 'volume_create_manager' (586ee7e6-2d87-4607-aded-3ff4cad4f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8fa94d38-d8ff-4f38-9051-05ac9aedd83f tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Created volume successfully. Jul 10 19:46:27 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:27 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb Jul 10 19:46:27 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:28 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb" returned: 0 in 0.642s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Lock "cinder-quobyte-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb" released by "delete_volume" :: held 1.511s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Created reservations ['9ae8c730-18ca-4ac8-8b04-771e564d42bf', 'e0877822-1806-4a7e-af79-fb5c0ff3c44a', '0db0204e-95f4-4bdb-89c1-60fd89e03bd3', 'aaec0e42-2194-4e0f-a58d-8d268276ac31'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:28 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:28 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:29 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.696s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:29 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Deleted volume successfully. Jul 10 19:46:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4b0d85ba-9987-46e8-a975-f62286cbfd0b tempest-VolumesMetadataTest-700940805 None] Lock "cinder-af9a8994-b4f6-46fb-94b0-b0c26fa0ccdb-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:31 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[839872ca-682e-48d9-b862-8c0bb7a38800]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:31 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 Jul 10 19:46:31 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:32 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98" returned: 0 in 0.854s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-43b550f2-a465-4e51-a44e-709068e5bd98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bda5715f-c160-415b-bfa3-c9a9b3efca15', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:46:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-2575c36d-98a1-4187-bf2d-27f9fbad27ab req-ee894036-4e48-485a-bef9-9cd39c82feb0 tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] attachment_update completed successfully. Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:37 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:37 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:38 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.007s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:46:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:46:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:46:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-e570784e-e3b4-45cf-a298-6b01b314fdf0 req-8435b13c-d294-4b89-a8a8-4e4644b6e8ad tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Terminate volume connection completed successfully. Jul 10 19:46:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-e570784e-e3b4-45cf-a298-6b01b314fdf0 req-8435b13c-d294-4b89-a8a8-4e4644b6e8ad tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Deleting attachment bda5715f-c160-415b-bfa3-c9a9b3efca15. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Flow 'volume_create_manager' (30cb9a79-24c2-4487-bad9-9f11cec56159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46988ba7-459d-4dc9-8628-7e828eb9ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46988ba7-459d-4dc9-8628-7e828eb9ea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1251168228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827f39fc-ef70-449b-b04f-40a140bab2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e58127533c6494b98932d1f3b0f94cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:46:42Z,use_quota=True,user_id='1a86efc0b91940338d25576164385e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7969d695-3ad6-4307-80f0-2c2b66ee1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7969d695-3ad6-4307-80f0-2c2b66ee1a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b029205-0f54-46f0-8d7d-bb3655de456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b029205-0f54-46f0-8d7d-bb3655de456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827f39fc-ef70-449b-b04f-40a140bab2de', 'volume_name': 'volume-827f39fc-ef70-449b-b04f-40a140bab2de', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9bff83-31af-4f25-bf59-b51d8504d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9bff83-31af-4f25-bf59-b51d8504d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569cd633-c099-48d8-b669-48b115daf927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Volume 827f39fc-ef70-449b-b04f-40a140bab2de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827f39fc-ef70-449b-b04f-40a140bab2de', 'volume_size': 1} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1251168228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827f39fc-ef70-449b-b04f-40a140bab2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e58127533c6494b98932d1f3b0f94cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:46:42Z,use_quota=True,user_id='1a86efc0b91940338d25576164385e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Creating volume 827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:46:41 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:46:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:41 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de 1073741824 Jul 10 19:46:41 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:42 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de 1073741824" returned: 0 in 0.978s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:42 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:46:42 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Acquiring lock "cinder-43b550f2-a465-4e51-a44e-709068e5bd98-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "cinder-43b550f2-a465-4e51-a44e-709068e5bd98-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Acquiring lock "cinder-quobyte-43b550f2-a465-4e51-a44e-709068e5bd98" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "cinder-quobyte-43b550f2-a465-4e51-a44e-709068e5bd98" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2d8d39-2d3c-4957-8f8d-45ec877e0cad]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:43 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 Jul 10 19:46:43 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:43 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.906s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569cd633-c099-48d8-b669-48b115daf927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827f39fc-ef70-449b-b04f-40a140bab2de', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a33b94a-8d6f-436e-8c8e-1e86d49a8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:46:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Volume volume-827f39fc-ef70-449b-b04f-40a140bab2de (827f39fc-ef70-449b-b04f-40a140bab2de): created successfully Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a33b94a-8d6f-436e-8c8e-1e86d49a8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:46:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Flow 'volume_create_manager' (30cb9a79-24c2-4487-bad9-9f11cec56159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:46:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c69ff0de-2326-4c21-bb75-544db85dda3a tempest-VolumesActionsTest-773969302 None] Created volume successfully. Jul 10 19:46:44 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98" returned: 0 in 0.918s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:44 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98 Jul 10 19:46:44 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:44 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-43b550f2-a465-4e51-a44e-709068e5bd98" returned: 0 in 0.740s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "cinder-quobyte-43b550f2-a465-4e51-a44e-709068e5bd98" released by "delete_volume" :: held 1.716s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Created reservations ['1f57de70-45cb-439b-b866-3cb8d873b46a', '54774206-c540-40b4-917f-d7b1d17b84b2', '67b56977-231d-418d-b71c-0ce8315abaac', '580a7df3-94c8-427f-ae7a-c676efba387b'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:46:45 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:46:45 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:46:45 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.786s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:46:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Deleted volume successfully. Jul 10 19:46:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e809fdc-33e7-48d9-a983-4177a2df3eea tempest-TestServerVolumeAttachScenarioOldVersion-498490491 None] Lock "cinder-43b550f2-a465-4e51-a44e-709068e5bd98-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:46:55 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=78,cinder:INSERT=32,cinder:UPDATE=92,cinder:DELETE=7 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:46:55 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=57,cinder:SELECT=35,cinder:INSERT=8,cinder:DELETE=5 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:47:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ff6ee614-d855-4292-a13a-32ff68dbb099 tempest-VolumesActionsTest-773969302 None] Acquiring lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de" by "attach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:47:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ff6ee614-d855-4292-a13a-32ff68dbb099 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de" acquired by "attach_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:47:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ff6ee614-d855-4292-a13a-32ff68dbb099 tempest-VolumesActionsTest-773969302 None] Attaching volume 827f39fc-ef70-449b-b04f-40a140bab2de to instance 00bdbb0a-7483-41a4-a46f-37fc0e2088c3 at mountpoint /dev/vdb on host None. Jul 10 19:47:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ff6ee614-d855-4292-a13a-32ff68dbb099 tempest-VolumesActionsTest-773969302 None] Attach volume completed successfully. Jul 10 19:47:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ff6ee614-d855-4292-a13a-32ff68dbb099 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de" released by "attach_volume" :: held 0.154s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:47:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c5f875fd-db35-4f81-9345-2ca20538a4e7 tempest-VolumesActionsTest-773969302 None] Acquiring lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-detach_volume" by "detach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:47:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c5f875fd-db35-4f81-9345-2ca20538a4e7 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:47:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c5f875fd-db35-4f81-9345-2ca20538a4e7 tempest-VolumesActionsTest-773969302 None] Detaching volume 827f39fc-ef70-449b-b04f-40a140bab2de from instance 00bdbb0a-7483-41a4-a46f-37fc0e2088c3. Jul 10 19:47:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c5f875fd-db35-4f81-9345-2ca20538a4e7 tempest-VolumesActionsTest-773969302 None] Detach volume completed successfully. Jul 10 19:47:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c5f875fd-db35-4f81-9345-2ca20538a4e7 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:47:14 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:INSERT=2,cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:47:14 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Flow 'volume_create_manager' (29c815a5-5e52-42ed-8759-8c2501fa36d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dfbce3-dfa2-4f6f-a211-bc97eb870f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dfbce3-dfa2-4f6f-a211-bc97eb870f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-106327315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f09910f-b0af-429f-b97a-e4ff7a170027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d5100c415423e9854234ad9d8d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:47:23Z,use_quota=True,user_id='a6378b799cf84ec0a0a7b5e62c10086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e53b4-808b-4204-a483-7fefd5aeffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e53b4-808b-4204-a483-7fefd5aeffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995763b4-011b-4bb9-9d25-2fffebc6ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995763b4-011b-4bb9-9d25-2fffebc6ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f09910f-b0af-429f-b97a-e4ff7a170027', 'volume_name': 'volume-2f09910f-b0af-429f-b97a-e4ff7a170027', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dafb9bc-eab8-4b9d-b474-224de7c8c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dafb9bc-eab8-4b9d-b474-224de7c8c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b9dd73-58e0-4f00-9eb4-a42d5605ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Volume 2f09910f-b0af-429f-b97a-e4ff7a170027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f09910f-b0af-429f-b97a-e4ff7a170027', 'volume_size': 1} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-106327315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f09910f-b0af-429f-b97a-e4ff7a170027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d5100c415423e9854234ad9d8d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:47:23Z,use_quota=True,user_id='a6378b799cf84ec0a0a7b5e62c10086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Creating volume 2f09910f-b0af-429f-b97a-e4ff7a170027 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:47:23 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:47:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:23 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 1073741824 Jul 10 19:47:23 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:24 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 1073741824" returned: 0 in 1.351s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:24 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 Jul 10 19:47:24 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:25 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027" returned: 0 in 0.920s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] <== create_volume: return (2321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b9dd73-58e0-4f00-9eb4-a42d5605ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f09910f-b0af-429f-b97a-e4ff7a170027', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eeb89b-cd7b-491f-abc4-7dc321b6812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Volume volume-2f09910f-b0af-429f-b97a-e4ff7a170027 (2f09910f-b0af-429f-b97a-e4ff7a170027): created successfully Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eeb89b-cd7b-491f-abc4-7dc321b6812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Flow 'volume_create_manager' (29c815a5-5e52-42ed-8759-8c2501fa36d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:47:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f4896680-4686-4d71-ae32-2242047018b8 tempest-AttachVolumeNegativeTest-254046757 None] Created volume successfully. Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-766ea2dc-594a-4576-b78e-70ea3950cc65 tempest-VolumesActionsTest-773969302 None] Acquiring lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de" by "attach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-766ea2dc-594a-4576-b78e-70ea3950cc65 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de" acquired by "attach_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:47:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-766ea2dc-594a-4576-b78e-70ea3950cc65 tempest-VolumesActionsTest-773969302 None] Attaching volume 827f39fc-ef70-449b-b04f-40a140bab2de to instance b26e619c-577f-4709-ac0a-4e8f75396995 at mountpoint /dev/vdb on host None. Jul 10 19:47:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-766ea2dc-594a-4576-b78e-70ea3950cc65 tempest-VolumesActionsTest-773969302 None] Attach volume completed successfully. Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-766ea2dc-594a-4576-b78e-70ea3950cc65 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de" released by "attach_volume" :: held 0.145s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1287538-4047-4087-808a-236e1eab4f12]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:29 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 Jul 10 19:47:29 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7ef49a1f-b88c-4606-b09e-cd6c6b1c5493 tempest-VolumesActionsTest-773969302 None] Acquiring lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-detach_volume" by "detach_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:47:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7ef49a1f-b88c-4606-b09e-cd6c6b1c5493 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:47:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7ef49a1f-b88c-4606-b09e-cd6c6b1c5493 tempest-VolumesActionsTest-773969302 None] Detaching volume 827f39fc-ef70-449b-b04f-40a140bab2de from instance b26e619c-577f-4709-ac0a-4e8f75396995. Jul 10 19:47:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7ef49a1f-b88c-4606-b09e-cd6c6b1c5493 tempest-VolumesActionsTest-773969302 None] Detach volume completed successfully. Jul 10 19:47:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7ef49a1f-b88c-4606-b09e-cd6c6b1c5493 tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:47:30 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027" returned: 0 in 1.036s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.058s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:47:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-2f09910f-b0af-429f-b97a-e4ff7a170027', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82166c5e-ec7e-4c95-b186-58bea881f2b0', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:47:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-f8d35866-c222-4018-a0b2-2d4789e21051 req-cf219bff-d67f-4389-bea0-b172322f3c4f tempest-AttachVolumeNegativeTest-254046757 None] attachment_update completed successfully. Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Flow 'volume_create_manager' (276a53b3-f4df-4fe8-beea-c17caa0eb6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f472eb4-9d9a-45a5-8f90-ed61e3d15ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f472eb4-9d9a-45a5-8f90-ed61e3d15ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1144122269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23ad5f9-10e7-437f-a279-2e1f98b5f9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c618380b28a40429097b5181d9a2196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:47:36Z,use_quota=True,user_id='42fa01c8e43b47319a7085d2a9c8120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e29cbc-df0d-4564-b57a-d3db0b232f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e29cbc-df0d-4564-b57a-d3db0b232f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca06a975-2562-4e55-a0e7-dfec76b66431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca06a975-2562-4e55-a0e7-dfec76b66431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e23ad5f9-10e7-437f-a279-2e1f98b5f9d2', 'volume_name': 'volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebda0c04-b058-4765-9fcd-9156569c10a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebda0c04-b058-4765-9fcd-9156569c10a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691fce7a-9523-4c5a-af79-71b1ce78e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:36 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Volume e23ad5f9-10e7-437f-a279-2e1f98b5f9d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 19:47:36 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Trying to clone e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:47:37 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Image download 20.69 MB at 20.69 MB/s Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0296e0-6cce-49fd-ba2f-1a9727a3ffc2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:37 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD Jul 10 19:47:37 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:47:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:37 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:47:37 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:38 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD" returned: 0 in 1.178s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f is fetched for user 42fa01c8e43b47319a7085d2a9c8120c. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:47:38 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.980s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[81487326-6ef1-45d9-9928-1a7316fc292c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:38 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD Jul 10 19:47:38 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:39 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD" returned: 0 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1144122269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23ad5f9-10e7-437f-a279-2e1f98b5f9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c618380b28a40429097b5181d9a2196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:47:36Z,use_quota=True,user_id='42fa01c8e43b47319a7085d2a9c8120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Creating volume e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:47:39 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:39 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 1073741824 Jul 10 19:47:39 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:47:40 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 1073741824" returned: 0 in 0.978s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:40 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:47:40 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:41 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.281s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca2283e-8cfc-434e-a0e4-52e2d8548697]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Attempting download of f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume e23ad5f9-10e7-437f-a279-2e1f98b5f9d2. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e942a2f1-312f-46d0-8fad-3d929cd98707]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:41 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:47:41 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:41 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf Jul 10 19:47:41 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:42 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:42 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f47115-7523-4c51-8a5d-78100b46415c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:42 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:47:42 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:42 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf Jul 10 19:47:42 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:42 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf" returned: 1 in 0.758s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_sf0sajkf' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133ad90-4e8f-47ac-814a-fdd6834ceee5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:42 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.787s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.cc319489-10a8-4b6e-834d-a7c6d64a843fifwnz797.img {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:42 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.cc319489-10a8-4b6e-834d-a7c6d64a843fifwnz797.img Jul 10 19:47:42 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:42 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD Jul 10 19:47:43 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:43 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD" returned: 0 in 1.044s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:43 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] f6bf008e-8dc3-4605-a3ec-36b1ff11d65f was qcow2, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:47:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:44 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:47:44 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:48 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 4.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:48 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_3obpxjdadevstack@QuobyteHD, size 112.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:47:48 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Converted 112.00 MB image at 22.68 MB/s Jul 10 19:47:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:48 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 1G Jul 10 19:47:48 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:48 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.cc319489-10a8-4b6e-834d-a7c6d64a843fifwnz797.img" returned: 0 in 6.086s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00ff404-c257-408d-91f7-118f2c32ae39]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:49 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:47:49 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:49 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 1G" returned: 0 in 0.787s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb05f3a-0788-4a74-8ab6-05d96796fa2b]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:47:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:49 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:47:49 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:50 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 1.040s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:50 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.cc319489-10a8-4b6e-834d-a7c6d64a843fifwnz797.img {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:47:50 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Converted 1024.00 MB image at 168.20 MB/s Jul 10 19:47:50 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] cc319489-10a8-4b6e-834d-a7c6d64a843f was raw, no need to convert to raw {{(pid=87164) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 19:47:50 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:47:50 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:47:50 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:47:51 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 1 in 0.792s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Downloaded image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f for user 42fa01c8e43b47319a7085d2a9c8120c is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Marking volume e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Copying metadata from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f to e23ad5f9-10e7-437f-a279-2e1f98b5f9d2. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Creating volume glance metadata for volume e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 backed by image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691fce7a-9523-4c5a-af79-71b1ce78e68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae463788-4159-44c7-aaf1-3acb9b6ab850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:47:51 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Volume volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 (e23ad5f9-10e7-437f-a279-2e1f98b5f9d2): created successfully Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae463788-4159-44c7-aaf1-3acb9b6ab850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:47:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Flow 'volume_create_manager' (276a53b3-f4df-4fe8-beea-c17caa0eb6e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:47:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-385633a2-38b9-418a-92b5-66ae40337051 tempest-TestShelveInstance-1697398830 None] Created volume successfully. Jul 10 19:47:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:48:09 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:48:09 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=14,cinder:SELECT=29,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:48:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.865s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Uploaded volume to glance image-id: cc319489-10a8-4b6e-834d-a7c6d64a843f. {{(pid=87164) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 19:48:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.517s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:48:13 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8ce924ba-73da-4b48-9e76-5eec05b421a1 tempest-VolumesActionsTest-773969302 None] Copy volume to image completed successfully. Jul 10 19:48:13 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde86b15-9b07-49b7-aa3b-519aa3b1f50b]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:13 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:48:13 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:14 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 0.825s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:14 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:48:14 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:48:14 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 1 in 0.796s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.670s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.361s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9180a7aa-6b0c-41fd-83a2-2511abb171b5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d63b1f2-59c4-4fa7-82dd-8819a76f4b51', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:48:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-876946d9-936f-4041-9b96-18ac6031f843 req-6002d0ca-82cd-476c-b25d-cfc0491335a2 tempest-TestShelveInstance-1697398830 None] attachment_update completed successfully. Jul 10 19:48:14 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:48:14 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:15 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.885s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00be290-3940-4592-84b3-387db7cb0e8e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:15 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:48:15 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:16 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:16 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img Jul 10 19:48:16 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:23 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img" returned: 0 in 6.525s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488fd0b-9d09-4a6f-891a-96cb0b618f95]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:23 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:48:23 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:24 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 1.164s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:24 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:48:24 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Converted 1024.00 MB image at 156.90 MB/s Jul 10 19:48:24 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] 998beb43-c6e4-49ef-a485-a33f7af4e372 was raw, converting to qcow2 {{(pid=87164) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 19:48:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d97a42-d229-4e71-9848-07f200db4a22]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:24 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img Jul 10 19:48:24 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:25 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img" returned: 0 in 1.359s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:25 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img Jul 10 19:48:25 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:26 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img" returned: 1 in 1.209s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:48:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img /opt/stack/data/cinder/conversion/vol_upload_ike8panq {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:26 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img /opt/stack/data/cinder/conversion/vol_upload_ike8panq Jul 10 19:48:26 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:27 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img /opt/stack/data/cinder/conversion/vol_upload_ike8panq" returned: 0 in 0.834s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:27 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Image conversion details: src /opt/stack/data/cinder/conversion/827f39fc-ef70-449b-b04f-40a140bab2de.temp_image.998beb43-c6e4-49ef-a485-a33f7af4e372u6alv78v.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ike8panq {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:48:27 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 19:48:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbf9732-574c-40e0-8c86-dfaa2812b611]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ike8panq {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:27 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ike8panq Jul 10 19:48:27 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:28 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ike8panq" returned: 0 in 0.880s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.371s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Uploaded volume to glance image-id: 998beb43-c6e4-49ef-a485-a33f7af4e372. {{(pid=87164) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 19:48:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-69dafe10-ab40-4f93-ae67-322ee15fb0de tempest-VolumesActionsTest-773969302 None] Copy volume to image completed successfully. Jul 10 19:48:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Acquiring lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:48:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:48:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Acquiring lock "cinder-quobyte-827f39fc-ef70-449b-b04f-40a140bab2de" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:48:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Lock "cinder-quobyte-827f39fc-ef70-449b-b04f-40a140bab2de" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:48:31 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af72411-cc8e-4bb7-8bb7-ebab87c5a0a3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:48:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:31 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:48:31 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:32 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:32 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de Jul 10 19:48:32 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-35eb0cd1-4309-4d1d-a4ab-71c0b1a11862 req-3553e8ff-c077-410f-ae9a-7624a26bfa84 tempest-AttachVolumeNegativeTest-254046757 None] Terminate volume connection completed successfully. Jul 10 19:48:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-35eb0cd1-4309-4d1d-a4ab-71c0b1a11862 req-3553e8ff-c077-410f-ae9a-7624a26bfa84 tempest-AttachVolumeNegativeTest-254046757 None] Deleting attachment 82166c5e-ec7e-4c95-b186-58bea881f2b0. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:48:32 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827f39fc-ef70-449b-b04f-40a140bab2de" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Lock "cinder-quobyte-827f39fc-ef70-449b-b04f-40a140bab2de" released by "delete_volume" :: held 1.616s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:48:32 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Created reservations ['8dfb6735-8739-4f5e-9df1-213143ae8ea1', '64f48bf4-7590-469d-bd74-c44e9d7b0855', 'b946c484-57ea-4730-a0e3-bc2674ecdd0f', 'd343856d-4b74-450d-9db9-b7121f78d2b1'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:33 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:48:33 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:33 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.726s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:48:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Deleted volume successfully. Jul 10 19:48:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8f7fe55d-3bc4-445c-9058-5dd0fdc2e12b tempest-VolumesActionsTest-773969302 None] Lock "cinder-827f39fc-ef70-449b-b04f-40a140bab2de-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:37 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:48:37 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:38 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.090s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:48:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:48:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:48:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Flow 'volume_create_manager' (5d8c7817-b79f-498a-a70d-439fb23b6b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a4b81e-fe74-4b27-80b5-5fa03fd94b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a4b81e-fe74-4b27-80b5-5fa03fd94b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1875876175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19428d7a-3be5-4471-9c98-708fbf4369a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a1dc34248434181bd8e000ece7e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:48:44Z,use_quota=True,user_id='21c96fad0ec5421e9fab318c947f1553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f7e604-1918-4d0d-bdb5-d6a2dc933b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f7e604-1918-4d0d-bdb5-d6a2dc933b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d08e7-dc1e-4e5c-bac6-68a225d33937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d08e7-dc1e-4e5c-bac6-68a225d33937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19428d7a-3be5-4471-9c98-708fbf4369a0', 'volume_name': 'volume-19428d7a-3be5-4471-9c98-708fbf4369a0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1b07e0-304b-4141-9c6f-ecda23175f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1b07e0-304b-4141-9c6f-ecda23175f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4e6a33-7465-4c26-8929-734a591abfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:48:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Volume 19428d7a-3be5-4471-9c98-708fbf4369a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19428d7a-3be5-4471-9c98-708fbf4369a0', 'volume_size': 1} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1875876175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19428d7a-3be5-4471-9c98-708fbf4369a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a1dc34248434181bd8e000ece7e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:48:44Z,use_quota=True,user_id='21c96fad0ec5421e9fab318c947f1553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Creating volume 19428d7a-3be5-4471-9c98-708fbf4369a0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:48:43 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:48:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:43 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 1073741824 Jul 10 19:48:43 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:44 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 1073741824" returned: 0 in 0.921s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:48:44 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 Jul 10 19:48:44 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:48:45 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0" returned: 0 in 0.718s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4e6a33-7465-4c26-8929-734a591abfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19428d7a-3be5-4471-9c98-708fbf4369a0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb597d-6b8d-486b-b681-3de1fa42b7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:48:45 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Volume volume-19428d7a-3be5-4471-9c98-708fbf4369a0 (19428d7a-3be5-4471-9c98-708fbf4369a0): created successfully Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb597d-6b8d-486b-b681-3de1fa42b7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:48:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Flow 'volume_create_manager' (5d8c7817-b79f-498a-a70d-439fb23b6b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:48:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7a9d90b7-03bb-4ff9-8f3f-85a817265141 tempest-VolumesNegativeTest-1954867601 None] Created volume successfully. Jul 10 19:48:55 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:48:55 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:48:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-615e978d-a0cd-49d2-b514-d8e9fee907a2 req-b1719d8d-aec0-44cf-956e-92f291eec4ca tempest-TestShelveInstance-1697398830 None] Terminate volume connection completed successfully. Jul 10 19:48:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-615e978d-a0cd-49d2-b514-d8e9fee907a2 req-b1719d8d-aec0-44cf-956e-92f291eec4ca tempest-TestShelveInstance-1697398830 None] Deleting attachment 3d63b1f2-59c4-4fa7-82dd-8819a76f4b51. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:49:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:49:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:49:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff89ce67-a4f3-40f7-aeb7-ed21f64bf125]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:49:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:03 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:49:03 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:04 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 1.088s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:05 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:49:05 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:06 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 1 in 1.191s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:49:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.329s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:49:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46a103c4-e845-4745-bbfa-b21232f60edf', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:49:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-4b5cd53f-ff22-4cc5-bdb1-9aa4f323c7db req-d0d8fe40-56c2-4fe3-9bf5-e551abc356a8 tempest-TestShelveInstance-1697398830 None] attachment_update completed successfully. Jul 10 19:49:16 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:49:16 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:49:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Acquiring lock "cinder-19428d7a-3be5-4471-9c98-708fbf4369a0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:49:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Lock "cinder-19428d7a-3be5-4471-9c98-708fbf4369a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:49:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Acquiring lock "cinder-quobyte-19428d7a-3be5-4471-9c98-708fbf4369a0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:49:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Lock "cinder-quobyte-19428d7a-3be5-4471-9c98-708fbf4369a0" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:49:20 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6e88e2-9dd1-47c9-8d4d-a1b61c6f19f5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:49:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:20 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 Jul 10 19:49:20 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:21 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0" returned: 0 in 0.877s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:21 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0 Jul 10 19:49:21 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:21 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-19428d7a-3be5-4471-9c98-708fbf4369a0" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Lock "cinder-quobyte-19428d7a-3be5-4471-9c98-708fbf4369a0" released by "delete_volume" :: held 1.643s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:49:21 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Created reservations ['6ea753df-d389-49ce-9c74-7f404ef3ec85', 'dc717983-00f4-4982-b170-ba6fffe329b2', '50b36a83-616a-48f1-b213-8326cdcd0e8d', 'd393d3f4-900f-418b-953a-83779fdd92f6'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:22 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:49:22 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:22 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.777s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:49:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Deleted volume successfully. Jul 10 19:49:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d7d6902f-cb97-4b39-8b6f-9bca99fdfafd tempest-VolumesNegativeTest-1954867601 None] Lock "cinder-19428d7a-3be5-4471-9c98-708fbf4369a0-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Flow 'volume_create_manager' (6578d178-6141-43fb-8eea-fc1e908fd5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af87d21-cda1-478d-872a-abfeeaff4dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af87d21-cda1-478d-872a-abfeeaff4dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1716571796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddd528d-14f7-4c57-a973-578e26c276f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d5100c415423e9854234ad9d8d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:49:25Z,use_quota=True,user_id='a6378b799cf84ec0a0a7b5e62c10086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12763801-3bc4-48de-a459-3f4693eaf188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12763801-3bc4-48de-a459-3f4693eaf188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c40d11-7b17-4b31-88e3-b8fefd475ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c40d11-7b17-4b31-88e3-b8fefd475ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ddd528d-14f7-4c57-a973-578e26c276f3', 'volume_name': 'volume-9ddd528d-14f7-4c57-a973-578e26c276f3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ac9c8c-67b2-4246-a5ff-7cda2306183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ac9c8c-67b2-4246-a5ff-7cda2306183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfe96d9-9241-427e-83d0-6db799dfafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:49:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Volume 9ddd528d-14f7-4c57-a973-578e26c276f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ddd528d-14f7-4c57-a973-578e26c276f3', 'volume_size': 1} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1716571796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddd528d-14f7-4c57-a973-578e26c276f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d5100c415423e9854234ad9d8d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:49:25Z,use_quota=True,user_id='a6378b799cf84ec0a0a7b5e62c10086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Creating volume 9ddd528d-14f7-4c57-a973-578e26c276f3 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:49:25 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:49:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:25 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 1073741824 Jul 10 19:49:25 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:26 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 1073741824" returned: 0 in 1.179s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:26 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 Jul 10 19:49:26 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:27 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfe96d9-9241-427e-83d0-6db799dfafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddd528d-14f7-4c57-a973-578e26c276f3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8da8c9f-86c4-47ec-bddb-0d2012d6aebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:49:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Volume volume-9ddd528d-14f7-4c57-a973-578e26c276f3 (9ddd528d-14f7-4c57-a973-578e26c276f3): created successfully Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8da8c9f-86c4-47ec-bddb-0d2012d6aebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:49:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Flow 'volume_create_manager' (6578d178-6141-43fb-8eea-fc1e908fd5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:49:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a67fbb0b-e05a-44e8-aff3-f755ca67d803 tempest-AttachVolumeNegativeTest-254046757 None] Created volume successfully. Jul 10 19:49:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:49:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:49:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec6f27-871e-432f-be53-f2febcca4e00]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:49:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:32 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 Jul 10 19:49:32 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:33 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3" returned: 0 in 0.931s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:49:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-9ddd528d-14f7-4c57-a973-578e26c276f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a9370ea-bd58-4855-943c-0188a0dd6b27', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:49:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-312b9f11-318a-4a4c-96be-2350c6d9cb04 req-cbe1bd27-abd3-4e72-97ae-960c57a742c2 tempest-AttachVolumeNegativeTest-254046757 None] attachment_update completed successfully. Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:49:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:49:37 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:49:37 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:49:38 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 10 19:49:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.847s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:49:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:49:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:49:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:49:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:49:39 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-d2aa9242-8c05-4c4f-bd4a-5dd324a5e903 req-07338337-f9bd-4f37-abd2-70e88b7380e5 tempest-AttachVolumeNegativeTest-254046757 None] Terminate volume connection completed successfully. Jul 10 19:49:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-d2aa9242-8c05-4c4f-bd4a-5dd324a5e903 req-07338337-f9bd-4f37-abd2-70e88b7380e5 tempest-AttachVolumeNegativeTest-254046757 None] Deleting attachment 3a9370ea-bd58-4855-943c-0188a0dd6b27. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:49:49 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=15,cinder:SELECT=14,cinder:DELETE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:49:49 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:50:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-f6d7fc41-196e-4d94-9174-0d3741284a99 tempest-TestShelveInstance-1697398830 None] Terminate volume connection completed successfully. Jul 10 19:50:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-f6d7fc41-196e-4d94-9174-0d3741284a99 tempest-TestShelveInstance-1697398830 None] Deleting attachment 46a103c4-e845-4745-bbfa-b21232f60edf. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:50:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Acquiring lock "cinder-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:50:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Lock "cinder-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:50:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Acquiring lock "cinder-quobyte-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:50:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Lock "cinder-quobyte-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:50:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274336d-6f93-47df-a47a-042d365d58a9]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:50:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:01 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:50:01 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:02 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 0.948s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:02 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:50:02 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:03 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 1 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:50:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:03 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2 Jul 10 19:50:03 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:04 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" returned: 0 in 1.534s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Lock "cinder-quobyte-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2" released by "delete_volume" :: held 3.483s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:50:04 devstack cinder-volume[87164]: DEBUG cinder.quota [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Created reservations ['80acc652-b924-498b-bfe9-0dc58d788fef', '4f741fa9-6fd8-45da-b641-0f71987530fd', 'e1f4732a-3e3c-44d8-8f20-bdb14000001c', '400e44c9-5630-4d10-ab4a-5ecbd043cdec'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:50:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:50:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:50:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:05 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:50:05 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:06 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.958s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:06 devstack cinder-volume[87164]: DEBUG cinder.manager [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:50:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Deleted volume successfully. Jul 10 19:50:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [req-cf8fe2fa-3295-4d48-8619-8ad13d681465 req-ffdc9062-340e-4f6d-b7f6-4d5cb8a724de tempest-TestShelveInstance-1697398830 None] Lock "cinder-e23ad5f9-10e7-437f-a279-2e1f98b5f9d2-delete_volume" released by "delete_volume" :: held 4.868s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Flow 'volume_create_manager' (f1a3c6c2-5a9b-47f9-ab08-0742b687f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e021ae8-930e-45df-a288-79f29d7f8dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e021ae8-930e-45df-a288-79f29d7f8dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-908585235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b798d857-4233-448d-80c0-45b5cbc8bf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c25c30eab0047d2bb4c86a564c1f8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:50:09Z,use_quota=True,user_id='62195bdec63f477d9559dfe6b678b7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f82a87-4124-434d-a927-7dfd4a793ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f82a87-4124-434d-a927-7dfd4a793ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60b3f6b-f080-406d-add4-2cdd7c9de048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60b3f6b-f080-406d-add4-2cdd7c9de048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b798d857-4233-448d-80c0-45b5cbc8bf10', 'volume_name': 'volume-b798d857-4233-448d-80c0-45b5cbc8bf10', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8308d3-ef33-4cc1-aefe-834ff865613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8308d3-ef33-4cc1-aefe-834ff865613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4963af46-4186-4504-a9ac-a924205004e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:09 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Volume b798d857-4233-448d-80c0-45b5cbc8bf10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b798d857-4233-448d-80c0-45b5cbc8bf10', 'volume_size': 1} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-908585235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b798d857-4233-448d-80c0-45b5cbc8bf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c25c30eab0047d2bb4c86a564c1f8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:50:09Z,use_quota=True,user_id='62195bdec63f477d9559dfe6b678b7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Creating volume b798d857-4233-448d-80c0-45b5cbc8bf10 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:50:09 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:50:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:09 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 1073741824 Jul 10 19:50:09 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:11 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 1073741824" returned: 0 in 2.172s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:11 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 Jul 10 19:50:11 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:12 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10" returned: 0 in 1.194s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] <== create_volume: return (3491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:50:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.496s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4963af46-4186-4504-a9ac-a924205004e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b798d857-4233-448d-80c0-45b5cbc8bf10', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a716d195-5c3a-41a1-99eb-8f84ba9ac0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:13 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Volume volume-b798d857-4233-448d-80c0-45b5cbc8bf10 (b798d857-4233-448d-80c0-45b5cbc8bf10): created successfully Jul 10 19:50:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a716d195-5c3a-41a1-99eb-8f84ba9ac0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Flow 'volume_create_manager' (f1a3c6c2-5a9b-47f9-ab08-0742b687f94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:50:13 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-38d66591-988d-4e2f-8afd-dfc1f1a01929 tempest-TestMinimumBasicScenario-1158287374 None] Created volume successfully. Jul 10 19:50:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[db61a8cf-d9ac-411e-9f26-3b04ed3c677d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:50:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:17 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 Jul 10 19:50:17 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:18 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10" returned: 0 in 0.955s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-b798d857-4233-448d-80c0-45b5cbc8bf10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bb5d939-617d-4636-ac00-a1eadbf22a1f', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:50:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-f8978d7b-3d2b-44a2-b9c4-c0fc035c0bba req-87713e21-024c-4661-9e79-96026c458b6c tempest-TestMinimumBasicScenario-1158287374 None] attachment_update completed successfully. Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Flow 'volume_create_manager' (e4633b54-0401-4bc6-a95f-759052890bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7e667e-d597-4d18-b0b8-c973c3f59e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7e667e-d597-4d18-b0b8-c973c3f59e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-987410080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1898c1d6-a929-494c-a92f-7454a38afc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d5100c415423e9854234ad9d8d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:50:32Z,use_quota=True,user_id='a6378b799cf84ec0a0a7b5e62c10086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a5d9c8-c734-4c2b-8dd2-882fc0adbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a5d9c8-c734-4c2b-8dd2-882fc0adbca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a0ab3-1607-467f-91c0-bd8af5adf4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a0ab3-1607-467f-91c0-bd8af5adf4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1898c1d6-a929-494c-a92f-7454a38afc4b', 'volume_name': 'volume-1898c1d6-a929-494c-a92f-7454a38afc4b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb6588e-c970-4b7b-8eed-db5ff7946936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb6588e-c970-4b7b-8eed-db5ff7946936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5920712f-3783-47ee-adcb-70ede21cdf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Volume 1898c1d6-a929-494c-a92f-7454a38afc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1898c1d6-a929-494c-a92f-7454a38afc4b', 'volume_size': 1} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-987410080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1898c1d6-a929-494c-a92f-7454a38afc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271d5100c415423e9854234ad9d8d7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:50:32Z,use_quota=True,user_id='a6378b799cf84ec0a0a7b5e62c10086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Creating volume 1898c1d6-a929-494c-a92f-7454a38afc4b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:50:32 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:50:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:32 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b 1073741824 Jul 10 19:50:32 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:33 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b 1073741824" returned: 0 in 0.991s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:33 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b Jul 10 19:50:33 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:34 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b" returned: 0 in 0.783s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5920712f-3783-47ee-adcb-70ede21cdf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1898c1d6-a929-494c-a92f-7454a38afc4b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d924f98-3528-4bad-a4ff-4cf36270866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:34 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Volume volume-1898c1d6-a929-494c-a92f-7454a38afc4b (1898c1d6-a929-494c-a92f-7454a38afc4b): created successfully Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d924f98-3528-4bad-a4ff-4cf36270866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Flow 'volume_create_manager' (e4633b54-0401-4bc6-a95f-759052890bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:50:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-34c90d2b-8974-4674-abd4-428e54c6853a tempest-AttachVolumeNegativeTest-254046757 None] Created volume successfully. Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5646aa-5483-4c07-b81b-b176ca57c8e4]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:50:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:37 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b Jul 10 19:50:37 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:38 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b" returned: 0 in 0.875s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-1898c1d6-a929-494c-a92f-7454a38afc4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04468ace-5f43-465a-92df-32f080f85670', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:50:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-33f86abf-c7f2-4072-b864-f4982094d647 req-a67b63ca-3735-4b28-bfc5-73e5b85fc064 tempest-AttachVolumeNegativeTest-254046757 None] attachment_update completed successfully. Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Flow 'volume_create_manager' (e0a943cf-06e8-4b1a-81e1-f45782bd99dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec81b20e-4bdb-4628-b982-af8e9ef12e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec81b20e-4bdb-4628-b982-af8e9ef12e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-469965060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3df5a4e-2294-450e-8d79-622e3569df75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5b0531d7a142a5a35df41d66365e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:50:46Z,use_quota=True,user_id='223258e339d04f92b421c37f445968e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53069b81-6e8a-47f5-95f4-d1e1d8f31efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53069b81-6e8a-47f5-95f4-d1e1d8f31efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d054cb51-472f-459a-9290-d31c5fdfef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d054cb51-472f-459a-9290-d31c5fdfef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3df5a4e-2294-450e-8d79-622e3569df75', 'volume_name': 'volume-c3df5a4e-2294-450e-8d79-622e3569df75', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6454d6-f769-43f1-b97c-45384057179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6454d6-f769-43f1-b97c-45384057179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a657e93-7a05-4886-b67b-d75de6311c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:45 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Volume c3df5a4e-2294-450e-8d79-622e3569df75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3df5a4e-2294-450e-8d79-622e3569df75', 'volume_size': 1} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-469965060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3df5a4e-2294-450e-8d79-622e3569df75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5b0531d7a142a5a35df41d66365e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:50:46Z,use_quota=True,user_id='223258e339d04f92b421c37f445968e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Creating volume c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:50:45 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:50:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:46 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 1073741824 Jul 10 19:50:46 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-7c072877-1d9b-48fa-8235-6bcdea2e8f4b req-7829ce80-c5b2-45f0-9d10-0e49daecd115 tempest-AttachVolumeNegativeTest-254046757 None] Terminate volume connection completed successfully. Jul 10 19:50:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-7c072877-1d9b-48fa-8235-6bcdea2e8f4b req-7829ce80-c5b2-45f0-9d10-0e49daecd115 tempest-AttachVolumeNegativeTest-254046757 None] Deleting attachment 04468ace-5f43-465a-92df-32f080f85670. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:50:47 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 1073741824" returned: 0 in 1.080s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:47 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:50:47 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:47 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 0.735s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a657e93-7a05-4886-b67b-d75de6311c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3df5a4e-2294-450e-8d79-622e3569df75', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cc0933-46d6-40d3-ac91-29f23c06e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:50:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Volume volume-c3df5a4e-2294-450e-8d79-622e3569df75 (c3df5a4e-2294-450e-8d79-622e3569df75): created successfully Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cc0933-46d6-40d3-ac91-29f23c06e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:50:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Flow 'volume_create_manager' (e0a943cf-06e8-4b1a-81e1-f45782bd99dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:50:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-662daff3-6279-4b62-a330-339ae5560ca4 tempest-TestStampPattern-1970690363 None] Created volume successfully. Jul 10 19:50:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "cinder-1898c1d6-a929-494c-a92f-7454a38afc4b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:50:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-1898c1d6-a929-494c-a92f-7454a38afc4b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:50:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "cinder-quobyte-1898c1d6-a929-494c-a92f-7454a38afc4b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:50:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-quobyte-1898c1d6-a929-494c-a92f-7454a38afc4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:50:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e59e2-fb72-477f-a718-eabbc33a3a04]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:50:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:57 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b Jul 10 19:50:57 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:58 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b" returned: 0 in 0.913s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:58 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b Jul 10 19:50:58 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:50:59 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1898c1d6-a929-494c-a92f-7454a38afc4b" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-quobyte-1898c1d6-a929-494c-a92f-7454a38afc4b" released by "delete_volume" :: held 1.663s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=30,cinder:INSERT=2,cinder:UPDATE=19,cinder:DELETE=4 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Created reservations ['c0bbd313-80c6-4d51-a523-d18112169ea0', 'ea1437b2-aadf-4d3a-8396-18fae31b5e07', '40a72cbf-3845-4232-b2dd-b9f8536677ae', 'f0e9a362-e781-4a06-b555-26bdcec61b33'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:50:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:50:59 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:50:59 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "cinder-9ddd528d-14f7-4c57-a973-578e26c276f3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-9ddd528d-14f7-4c57-a973-578e26c276f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "cinder-quobyte-9ddd528d-14f7-4c57-a973-578e26c276f3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-quobyte-9ddd528d-14f7-4c57-a973-578e26c276f3" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bfe94-8fce-4c43-8495-e17121b9d405]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:00 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.779s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Deleted volume successfully. Jul 10 19:51:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3336dda5-27c1-460c-b736-528e7160a6bb tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-1898c1d6-a929-494c-a92f-7454a38afc4b-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:00 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 Jul 10 19:51:00 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:01 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3" returned: 0 in 0.846s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:01 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3 Jul 10 19:51:01 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:01 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-9ddd528d-14f7-4c57-a973-578e26c276f3" returned: 0 in 0.758s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-quobyte-9ddd528d-14f7-4c57-a973-578e26c276f3" released by "delete_volume" :: held 1.654s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:01 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Created reservations ['693a77f8-f801-45ae-aa8e-9b21b60d058f', '21a685bb-0ece-4daf-8f27-705de9d94e43', 'fe449a66-79de-4eeb-805b-342b1576e77c', 'a1a2835c-4481-4d3f-a7f6-f4d187363e11'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:02 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:51:02 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "cinder-2f09910f-b0af-429f-b97a-e4ff7a170027-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-2f09910f-b0af-429f-b97a-e4ff7a170027-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:02 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "cinder-quobyte-2f09910f-b0af-429f-b97a-e4ff7a170027" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Deleted volume successfully. Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-quobyte-2f09910f-b0af-429f-b97a-e4ff7a170027" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f0855706-140c-461d-8e22-7a883a837a88 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-9ddd528d-14f7-4c57-a973-578e26c276f3-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be8cddc-f9f4-4fc7-945b-02b13f508364]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:03 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 Jul 10 19:51:03 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:03 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:03 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027 Jul 10 19:51:03 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:04 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-2f09910f-b0af-429f-b97a-e4ff7a170027" returned: 0 in 0.774s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-quobyte-2f09910f-b0af-429f-b97a-e4ff7a170027" released by "delete_volume" :: held 1.684s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Created reservations ['b91e9350-bd45-4113-a0db-dcdc6cd6f727', 'e30d08da-84c1-4323-b4d4-6a4c71bec2be', '8b73dbab-56c5-48ea-a20b-1fdf256a2d98', '10db75c3-e8c8-4c83-8252-229c595cf904'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:04 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:51:04 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:05 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.226s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:05 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Deleted volume successfully. Jul 10 19:51:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d76e724d-08bb-4fe9-b2a8-af02172fcaf3 tempest-AttachVolumeNegativeTest-254046757 None] Lock "cinder-2f09910f-b0af-429f-b97a-e4ff7a170027-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-3204ff2a-1f43-4957-9ad5-779d9dcb7f9a req-6c732750-c468-43cb-8e4a-5b1ca7b5e8de tempest-TestMinimumBasicScenario-1158287374 None] Terminate volume connection completed successfully. Jul 10 19:51:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-3204ff2a-1f43-4957-9ad5-779d9dcb7f9a req-6c732750-c468-43cb-8e4a-5b1ca7b5e8de tempest-TestMinimumBasicScenario-1158287374 None] Deleting attachment 1bb5d939-617d-4636-ac00-a1eadbf22a1f. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:51:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Acquiring lock "cinder-b798d857-4233-448d-80c0-45b5cbc8bf10-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Lock "cinder-b798d857-4233-448d-80c0-45b5cbc8bf10-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Acquiring lock "cinder-quobyte-b798d857-4233-448d-80c0-45b5cbc8bf10" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Lock "cinder-quobyte-b798d857-4233-448d-80c0-45b5cbc8bf10" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ade13c4-27ec-4767-bc08-b16d2ec18616]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:12 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 Jul 10 19:51:12 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:13 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10" returned: 0 in 0.869s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:13 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10 Jul 10 19:51:13 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:13 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b798d857-4233-448d-80c0-45b5cbc8bf10" returned: 0 in 0.656s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Lock "cinder-quobyte-b798d857-4233-448d-80c0-45b5cbc8bf10" released by "delete_volume" :: held 1.582s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Created reservations ['cdd229e1-3567-4676-a4da-b2cf8604792f', '20260300-7e18-4584-8d48-815f707f0531', 'd9d91156-8bd8-4945-8306-9877ebe1c1de', '7d847f27-0122-4f42-802d-ae8ee338481f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:14 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:51:14 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Flow 'volume_create_manager' (582a8f29-7d99-4a0b-8589-c440f7339316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f26e8-be5e-4dff-ab6e-7a8472cbcf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f26e8-be5e-4dff-ab6e-7a8472cbcf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1633990713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8be73bcc6448cbc0350a706ac62c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:14Z,use_quota=True,user_id='a03153645b09481090307f3c51468541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3b92ba-dbfd-4103-8ce5-5425d668b0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3b92ba-dbfd-4103-8ce5-5425d668b0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673c972b-b687-40e4-8406-8b45a004101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673c972b-b687-40e4-8406-8b45a004101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b', 'volume_name': 'volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb71be4-23b7-4c22-a323-4c5b96ca5644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb71be4-23b7-4c22-a323-4c5b96ca5644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e42e86-8513-45db-a626-70d0259e740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Volume db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b', 'volume_size': 1} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1633990713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8be73bcc6448cbc0350a706ac62c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:14Z,use_quota=True,user_id='a03153645b09481090307f3c51468541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Creating volume db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:51:14 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:14 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b 1073741824 Jul 10 19:51:14 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:14 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.745s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Deleted volume successfully. Jul 10 19:51:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8499145a-d70e-448b-ac7b-8d459f041259 tempest-TestMinimumBasicScenario-1158287374 None] Lock "cinder-b798d857-4233-448d-80c0-45b5cbc8bf10-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:15 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b 1073741824" returned: 0 in 0.868s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:15 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b Jul 10 19:51:15 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:15 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b" returned: 0 in 0.684s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e42e86-8513-45db-a626-70d0259e740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6126696-fc64-4e69-8591-70392c3667cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Volume volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b (db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b): created successfully Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6126696-fc64-4e69-8591-70392c3667cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Flow 'volume_create_manager' (582a8f29-7d99-4a0b-8589-c440f7339316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-711da921-272d-4dbf-9dcc-8bcc6a847987 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Created volume successfully. Jul 10 19:51:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Acquiring lock "cinder-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "cinder-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Acquiring lock "cinder-quobyte-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "cinder-quobyte-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce9e2a9-e5d9-405a-9762-474823ab1ca5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:17 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b Jul 10 19:51:17 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:18 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b" returned: 0 in 0.811s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:18 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b Jul 10 19:51:18 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:19 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "cinder-quobyte-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b" released by "delete_volume" :: held 1.525s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Created reservations ['d5c1c1e4-9637-4fb1-b03b-071900663a3b', '9a8d5df6-1f85-4ebd-b021-f4995237a0a9', '3b0165d5-d5bc-449a-bccf-e58133a8b183', '9169364c-f946-4dc7-9814-e9d0dda2f2ad'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:19 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:51:19 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:19 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.647s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:19 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Deleted volume successfully. Jul 10 19:51:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f10934f3-9c33-44a5-b30d-c041b89abd52 tempest-VolumeQuotasNegativeTestJSON-1244950468 None] Lock "cinder-db808fd2-8f9b-464c-a3bb-7fe5d5fe9a0b-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Flow 'volume_create_manager' (8fbdce6e-91ac-45e7-834f-9116dd2bbd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c805ef7-7e87-443b-9022-89f60e24873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c805ef7-7e87-443b-9022-89f60e24873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-656611211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505e2081-ec02-4dea-a0f1-63e2eb920eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5386c6aa4ad74328984f8e696480b365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:25Z,use_quota=True,user_id='fc3d66d559ec46c794ca1103015906f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a388372-ad57-4e74-87f0-7000f072ef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a388372-ad57-4e74-87f0-7000f072ef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac345301-1f08-4e0c-9f61-d66021fa9302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac345301-1f08-4e0c-9f61-d66021fa9302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505e2081-ec02-4dea-a0f1-63e2eb920eb5', 'volume_name': 'volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc98d93-6157-452f-82b2-2905e5f4f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc98d93-6157-452f-82b2-2905e5f4f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e66512-5095-4c42-b250-b848a15290f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Volume 505e2081-ec02-4dea-a0f1-63e2eb920eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5', 'volume_size': 1} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-656611211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505e2081-ec02-4dea-a0f1-63e2eb920eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5386c6aa4ad74328984f8e696480b365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:25Z,use_quota=True,user_id='fc3d66d559ec46c794ca1103015906f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Creating volume 505e2081-ec02-4dea-a0f1-63e2eb920eb5 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:51:25 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:51:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:25 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 1073741824 Jul 10 19:51:25 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:26 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 1073741824" returned: 0 in 0.988s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:26 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 Jul 10 19:51:26 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:27 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5" returned: 0 in 0.691s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e66512-5095-4c42-b250-b848a15290f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91729b71-9d16-4631-a41c-433e81257dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Volume volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 (505e2081-ec02-4dea-a0f1-63e2eb920eb5): created successfully Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91729b71-9d16-4631-a41c-433e81257dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Flow 'volume_create_manager' (8fbdce6e-91ac-45e7-834f-9116dd2bbd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f35fdddd-55e7-4217-8019-91e787340df4 tempest-VolumesServicesTestJSON-1042589507 None] Created volume successfully. Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Acquiring lock "cinder-505e2081-ec02-4dea-a0f1-63e2eb920eb5-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Lock "cinder-505e2081-ec02-4dea-a0f1-63e2eb920eb5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Acquiring lock "cinder-quobyte-505e2081-ec02-4dea-a0f1-63e2eb920eb5" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Lock "cinder-quobyte-505e2081-ec02-4dea-a0f1-63e2eb920eb5" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[310040aa-ccf5-49d4-8329-42673e7d64f6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:27 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 Jul 10 19:51:27 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:28 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5" returned: 0 in 0.829s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:28 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5 Jul 10 19:51:28 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aa2678-c7f2-4a9f-a652-a44685adac5a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:29 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:51:29 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:29 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-505e2081-ec02-4dea-a0f1-63e2eb920eb5" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Lock "cinder-quobyte-505e2081-ec02-4dea-a0f1-63e2eb920eb5" released by "delete_volume" :: held 1.700s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Created reservations ['2c221b05-d283-4dd5-a340-f3c2edd0134c', 'ee347f25-4f89-4169-9091-76b36bc24470', 'a1094b51-3e4e-44a0-b229-7da8076b2cb5', '9c1c3abb-c5aa-4ef5-a0dd-44c08b32076a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:29 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:51:29 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:30 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 1.048s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-c3df5a4e-2294-450e-8d79-622e3569df75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe71c7d1-162a-4bd1-8942-7c44739fa069', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:51:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-5c6be579-b441-4264-ba4e-2581ef88a2f6 req-f8546fa2-db8c-4f8f-b0ca-4f1a18f4e39f tempest-TestStampPattern-1970690363 None] attachment_update completed successfully. Jul 10 19:51:30 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:30 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Deleted volume successfully. Jul 10 19:51:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0c950072-48ae-4665-9a6c-d5d51732641d tempest-VolumesServicesTestJSON-1042589507 None] Lock "cinder-505e2081-ec02-4dea-a0f1-63e2eb920eb5-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:37 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:51:37 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:38 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.994s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:51:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:51:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:51:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:51:39 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-b29aaaa8-cae2-4957-ae25-93979379fbdd req-19e518bf-5305-477a-8cbb-000ec95e7044 tempest-TestStampPattern-1970690363 None] Terminate volume connection completed successfully. Jul 10 19:51:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-b29aaaa8-cae2-4957-ae25-93979379fbdd req-19e518bf-5305-477a-8cbb-000ec95e7044 tempest-TestStampPattern-1970690363 None] Deleting attachment fe71c7d1-162a-4bd1-8942-7c44739fa069. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:51:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Creating offline snapshot 0808ca1c-8d23-4b29-ba16-864ee85a113c of volume c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:51:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab39a8-f4b7-41aa-98b2-07a2caa0ab37]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:42 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:51:42 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:43 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 0.921s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:43 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c 1G Jul 10 19:51:43 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:44 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c 1G" returned: 0 in 1.028s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3df5a4e-2294-450e-8d79-622e3569df75 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:44 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3df5a4e-2294-450e-8d79-622e3569df75 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c Jul 10 19:51:44 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:45 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3df5a4e-2294-450e-8d79-622e3569df75 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c" returned: 0 in 0.882s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:45 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c is being set with open permissions: ugo+rw Jul 10 19:51:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:45 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c Jul 10 19:51:45 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:45 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c" returned: 0 in 0.739s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:45 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info Jul 10 19:51:45 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:46 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info" returned: 0 in 0.770s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:46 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info is being set with open permissions: ugo+rw Jul 10 19:51:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:46 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info Jul 10 19:51:46 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:47 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.info" returned: 0 in 0.737s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.213s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5c1b9d93-4dee-40a3-b6ba-4cb75e529c28 tempest-TestStampPattern-1970690363 None] Create snapshot completed successfully Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Flow 'volume_create_manager' (ea2fc786-89d6-42f4-80cb-03d3b59358f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc76b2e-73d3-4738-bf6f-51e38c3de992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc76b2e-73d3-4738-bf6f-51e38c3de992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-420417914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20a9707-66c1-48c5-b249-a95c465af370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75687c48e36445e98c9f75f0430b3a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:48Z,use_quota=True,user_id='102906e93bfd44ca90572cbd4ed5b823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6bccba-ecb0-48f4-86ac-9a03ee5bfc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6bccba-ecb0-48f4-86ac-9a03ee5bfc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d155c7-296b-4b16-8f77-4c24bd668027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d155c7-296b-4b16-8f77-4c24bd668027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c20a9707-66c1-48c5-b249-a95c465af370', 'volume_name': 'volume-c20a9707-66c1-48c5-b249-a95c465af370', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a37c56-c88a-4ca1-ad8c-b2339348fc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a37c56-c88a-4ca1-ad8c-b2339348fc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239b47dc-be70-4398-9581-3af68e574426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:48 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Volume c20a9707-66c1-48c5-b249-a95c465af370: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c20a9707-66c1-48c5-b249-a95c465af370', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Trying to clone c20a9707-66c1-48c5-b249-a95c465af370 from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:51:48 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Image download 20.69 MB at 20.69 MB/s Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c5d9df-12d1-492a-b7cc-765274ec2184]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:49 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD Jul 10 19:51:49 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:49 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:49 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f is fetched for user 102906e93bfd44ca90572cbd4ed5b823. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:51:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e6859-7bbb-4731-a64a-f9dbab1ab089]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:49 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD Jul 10 19:51:49 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:50 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-420417914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20a9707-66c1-48c5-b249-a95c465af370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75687c48e36445e98c9f75f0430b3a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:48Z,use_quota=True,user_id='102906e93bfd44ca90572cbd4ed5b823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Creating volume c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:51:50 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:51:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:50 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 1073741824 Jul 10 19:51:50 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:51 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 1073741824" returned: 0 in 0.970s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:51 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:51:51 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:52 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 0 in 0.839s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:51:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:52 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Attempting download of f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume c20a9707-66c1-48c5-b249-a95c465af370. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:51:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[274df867-2377-4812-b4bd-f3bb9ebb4153]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:52 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl Jul 10 19:51:52 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:53 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl" returned: 0 in 0.981s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:53 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl Jul 10 19:51:53 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:54 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl" returned: 1 in 0.820s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_v9jbp3xl' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:51:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7d3a5b-ab4d-4915-b389-0dfd492fd031]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:54 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD Jul 10 19:51:54 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:55 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:55 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] f6bf008e-8dc3-4605-a3ec-36b1ff11d65f was qcow2, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:51:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:55 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:51:55 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Flow 'volume_create_manager' (02bb51a7-de2c-49e2-96b9-f971e5e3cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f61d3-2f66-4d1e-860e-dd16b55793ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f61d3-2f66-4d1e-860e-dd16b55793ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-96316418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31cfd328-8328-4acf-9dc6-a2b238a8c12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2725d93f3d9647cd9100ef8168038d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:57Z,use_quota=True,user_id='2887b186900d47bc87fe04647d984112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a670a8-30e4-415a-aeef-382d15964191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a670a8-30e4-415a-aeef-382d15964191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d916b3-7b2c-4cda-ac7f-0f4d3398fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d916b3-7b2c-4cda-ac7f-0f4d3398fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31cfd328-8328-4acf-9dc6-a2b238a8c12f', 'volume_name': 'volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b846186-20ac-4655-8652-fe07e44253f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b846186-20ac-4655-8652-fe07e44253f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69d36c2-269e-45c8-800c-c2467e108e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:56 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Volume 31cfd328-8328-4acf-9dc6-a2b238a8c12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f', 'volume_size': 1} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-96316418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31cfd328-8328-4acf-9dc6-a2b238a8c12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2725d93f3d9647cd9100ef8168038d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:57Z,use_quota=True,user_id='2887b186900d47bc87fe04647d984112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Creating volume 31cfd328-8328-4acf-9dc6-a2b238a8c12f {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:51:56 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:51:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:56 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f 1073741824 Jul 10 19:51:56 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Flow 'volume_create_manager' (ffcf01eb-e3ee-4c24-935f-884da5ee87fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8453d7d-fcfc-4251-bc63-5b1cf8c0ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8453d7d-fcfc-4251-bc63-5b1cf8c0ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1721123974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2725d93f3d9647cd9100ef8168038d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:57Z,use_quota=True,user_id='2887b186900d47bc87fe04647d984112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a875c622-69e6-49e3-8776-889d0f114426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a875c622-69e6-49e3-8776-889d0f114426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c7c2f4-7f8e-4870-ab81-e3a4e1852e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c7c2f4-7f8e-4870-ab81-e3a4e1852e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995', 'volume_name': 'volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f910d86-5169-4cdc-858b-1a5c75c33de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f910d86-5169-4cdc-858b-1a5c75c33de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24320c8-0e83-46cb-bf15-c2e37ee08ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:57 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Volume b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995', 'volume_size': 1} Jul 10 19:51:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 0 in 2.590s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_kqpjjafmdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:51:58 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Converted 112.00 MB image at 43.22 MB/s Jul 10 19:51:58 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:58 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 1G Jul 10 19:51:58 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:58 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f 1073741824" returned: 0 in 1.554s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:58 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f Jul 10 19:51:58 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:58 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 1G" returned: 0 in 0.803s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c21b94-d8e0-4a9c-92bc-32946c9a0e36]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:51:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:59 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:51:59 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:59 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.441s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1721123974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2725d93f3d9647cd9100ef8168038d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:51:57Z,use_quota=True,user_id='2887b186900d47bc87fe04647d984112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Creating volume b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:51:59 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69d36c2-269e-45c8-800c-c2467e108e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:59 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 1073741824 Jul 10 19:51:59 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c1aefc-0303-4d42-9148-a3c0497bc445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:51:59 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Volume volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f (31cfd328-8328-4acf-9dc6-a2b238a8c12f): created successfully Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c1aefc-0303-4d42-9148-a3c0497bc445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Flow 'volume_create_manager' (02bb51a7-de2c-49e2-96b9-f971e5e3cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:51:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-eeffbd9b-a773-4a93-9db9-3cdade4ba917 tempest-TestServerVolumeAttachmentScenario-94194818 None] Created volume successfully. Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:INSERT=18,cinder:UPDATE=58,cinder:SELECT=48,cinder:DELETE=6 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=51,cinder:INSERT=12,cinder:UPDATE=68,cinder:DELETE=4 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:51:59 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 0 in 1.069s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:51:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Flow 'volume_create_manager' (67caa0be-6e3a-4810-8a71-bf0c9135ea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99679d2f-95ec-483d-a3a0-752845cb2518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99679d2f-95ec-483d-a3a0-752845cb2518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1693753651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b94baee-9c50-411a-bea0-6be2c036a283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5b0531d7a142a5a35df41d66365e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0808ca1c-8d23-4b29-ba16-864ee85a113c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:00Z,use_quota=True,user_id='223258e339d04f92b421c37f445968e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccd27ce-dfbc-44fe-8252-e1ccabb30730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccd27ce-dfbc-44fe-8252-e1ccabb30730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684464a2-8190-4b1a-84f2-e45e2027d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684464a2-8190-4b1a-84f2-e45e2027d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b94baee-9c50-411a-bea0-6be2c036a283', 'volume_name': 'volume-1b94baee-9c50-411a-bea0-6be2c036a283', 'volume_size': 1, 'snapshot_id': '0808ca1c-8d23-4b29-ba16-864ee85a113c'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba121aa-8742-491e-8fc0-e91240cb6c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba121aa-8742-491e-8fc0-e91240cb6c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:00 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:52:00 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6dd49a-2141-4fa7-bf2a-1d56a08f04fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Volume 1b94baee-9c50-411a-bea0-6be2c036a283: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b94baee-9c50-411a-bea0-6be2c036a283', 'volume_size': 1, 'snapshot_id': '0808ca1c-8d23-4b29-ba16-864ee85a113c'} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:00 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 1073741824" returned: 0 in 1.232s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:00 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 Jul 10 19:52:00 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:00 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 1 in 0.995s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Downloaded image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume c20a9707-66c1-48c5-b249-a95c465af370 successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f for user 102906e93bfd44ca90572cbd4ed5b823 is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:52:00 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Marking volume c20a9707-66c1-48c5-b249-a95c465af370 as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Copying metadata from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f to c20a9707-66c1-48c5-b249-a95c465af370. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Creating volume glance metadata for volume c20a9707-66c1-48c5-b249-a95c465af370 backed by image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239b47dc-be70-4398-9581-3af68e574426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20a9707-66c1-48c5-b249-a95c465af370', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a56cbca-8644-4b77-8b82-623be4358824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:01 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Volume volume-c20a9707-66c1-48c5-b249-a95c465af370 (c20a9707-66c1-48c5-b249-a95c465af370): created successfully Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a56cbca-8644-4b77-8b82-623be4358824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Flow 'volume_create_manager' (ea2fc786-89d6-42f4-80cb-03d3b59358f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-762704bc-bc09-4c41-b5b1-87b0aa7b6d39 tempest-VolumesImageMetadata-118019618 None] Created volume successfully. Jul 10 19:52:01 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" returned: 0 in 0.890s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.169s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-quobyte-0808ca1c-8d23-4b29-ba16-864ee85a113c-1b94baee-9c50-411a-bea0-6be2c036a283" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24320c8-0e83-46cb-bf15-c2e37ee08ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a377d2a4-afbd-4fd8-8e79-7f553457ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-0808ca1c-8d23-4b29-ba16-864ee85a113c-1b94baee-9c50-411a-bea0-6be2c036a283" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Creating volume 1b94baee-9c50-411a-bea0-6be2c036a283 from snapshot 0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-quobyte-1b94baee-9c50-411a-bea0-6be2c036a283" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:01 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Volume volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 (b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995): created successfully Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a377d2a4-afbd-4fd8-8e79-7f553457ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Flow 'volume_create_manager' (ffcf01eb-e3ee-4c24-935f-884da5ee87fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-1b94baee-9c50-411a-bea0-6be2c036a283" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] snapshot: 0808ca1c-8d23-4b29-ba16-864ee85a113c, volume: 1b94baee-9c50-411a-bea0-6be2c036a283, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:52:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-88ecc27b-c188-4894-b00e-791c2407c391 tempest-TestServerVolumeAttachmentScenario-94194818 None] Created volume successfully. Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[306b5ccd-137b-4884-8d1e-89a71a502354]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:01 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c Jul 10 19:52:01 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:02 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c" returned: 0 in 0.806s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3df5a4e-2294-450e-8d79-622e3569df75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696547b-112c-40cf-af87-4fe5bc3b27a2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:02 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:52:02 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Acquiring lock "cinder-c20a9707-66c1-48c5-b249-a95c465af370-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Lock "cinder-c20a9707-66c1-48c5-b249-a95c465af370-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Acquiring lock "cinder-quobyte-c20a9707-66c1-48c5-b249-a95c465af370" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Lock "cinder-quobyte-c20a9707-66c1-48c5-b249-a95c465af370" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5552abc6-9b15-40e4-a3cd-d2c636c9908e]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:03 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:52:03 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:03 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 0.889s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:03 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:52:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:03 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 Jul 10 19:52:03 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:03 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 0 in 0.866s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:03 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:52:03 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:05 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 1 in 1.459s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:52:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:05 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370 Jul 10 19:52:05 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:07 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c20a9707-66c1-48c5-b249-a95c465af370" returned: 0 in 2.429s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Lock "cinder-quobyte-c20a9707-66c1-48c5-b249-a95c465af370" released by "delete_volume" :: held 4.900s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:07 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Created reservations ['47ce95cf-5050-4366-aca8-68e7ce8ed7d8', '361bee94-ea66-45f9-afdc-483f7cebf924', '5b84b40f-ffce-4116-a15d-a6d3887dcf8c', '23b2a3fd-926e-4079-967f-b3066e2cdac4'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:52:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:08 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:52:08 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:09 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.717s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:09 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:52:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Deleted volume successfully. Jul 10 19:52:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-fa89d456-e7c1-4228-af85-d354f0181145 tempest-VolumesImageMetadata-118019618 None] Lock "cinder-c20a9707-66c1-48c5-b249-a95c465af370-delete_volume" released by "delete_volume" :: held 7.127s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:10 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283" returned: 0 in 6.914s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:10 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ed895-3290-42f2-9be0-5e0f9975ec8c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:10 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:52:10 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:11 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 1.458s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:11 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:52:11 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Converted 1024.00 MB image at 148.09 MB/s Jul 10 19:52:11 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 is being set with open permissions: ugo+rw Jul 10 19:52:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:11 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 Jul 10 19:52:11 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:12 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283" returned: 0 in 1.072s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-1b94baee-9c50-411a-bea0-6be2c036a283" released by "_copy_volume_from_snapshot" :: held 11.279s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-0808ca1c-8d23-4b29-ba16-864ee85a113c-1b94baee-9c50-411a-bea0-6be2c036a283" released by "_create_volume_from_snapshot" :: held 11.329s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.360s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6dd49a-2141-4fa7-bf2a-1d56a08f04fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b94baee-9c50-411a-bea0-6be2c036a283', 'volume_size': 1, 'snapshot_id': '0808ca1c-8d23-4b29-ba16-864ee85a113c'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a375b533-4faa-4bee-a890-4453dca47652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:12 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Volume volume-1b94baee-9c50-411a-bea0-6be2c036a283 (1b94baee-9c50-411a-bea0-6be2c036a283): created successfully Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a375b533-4faa-4bee-a890-4453dca47652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Flow 'volume_create_manager' (67caa0be-6e3a-4810-8a71-bf0c9135ea19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e6cee903-edf4-473e-99bf-202a46e070be tempest-TestStampPattern-1970690363 None] Created volume successfully. Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Flow 'volume_create_manager' (ac2c9576-f1bb-4d47-8dfd-30f490ec7bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd709519-4c32-4b20-ad68-9fc2302a6888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd709519-4c32-4b20-ad68-9fc2302a6888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-710508252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f7123c-e869-455f-9e0a-284e9c7462ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902b213f87cf488eb835a337d405af13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:14Z,use_quota=True,user_id='2cd59895e2854f2ea2c0a7c58e645204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f72364-3cea-4e39-b46f-7a7c322bdcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f72364-3cea-4e39-b46f-7a7c322bdcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a683f832-5c20-4fc8-9b35-0b0c4d02bed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a683f832-5c20-4fc8-9b35-0b0c4d02bed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f7123c-e869-455f-9e0a-284e9c7462ea', 'volume_name': 'volume-60f7123c-e869-455f-9e0a-284e9c7462ea', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448851f9-4d25-47a6-8c70-477a5e8bb3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448851f9-4d25-47a6-8c70-477a5e8bb3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aab35db-bb6b-4bb3-ba2e-f77d0293939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Volume 60f7123c-e869-455f-9e0a-284e9c7462ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f7123c-e869-455f-9e0a-284e9c7462ea', 'volume_size': 1} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-710508252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f7123c-e869-455f-9e0a-284e9c7462ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902b213f87cf488eb835a337d405af13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:14Z,use_quota=True,user_id='2cd59895e2854f2ea2c0a7c58e645204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Creating volume 60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:52:14 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:52:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:14 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea 1073741824 Jul 10 19:52:14 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:15 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea 1073741824" returned: 0 in 0.883s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:15 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea Jul 10 19:52:15 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:16 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea" returned: 0 in 1.284s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aab35db-bb6b-4bb3-ba2e-f77d0293939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f7123c-e869-455f-9e0a-284e9c7462ea', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f068dd-03c0-49d5-b497-4370f4d144d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:16 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Volume volume-60f7123c-e869-455f-9e0a-284e9c7462ea (60f7123c-e869-455f-9e0a-284e9c7462ea): created successfully Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f068dd-03c0-49d5-b497-4370f4d144d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Flow 'volume_create_manager' (ac2c9576-f1bb-4d47-8dfd-30f490ec7bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-947b4f35-630d-41b7-a0a9-9e3866b81492 tempest-SnapshotMetadataTestJSON-1423227852 None] Created volume successfully. Jul 10 19:52:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Creating offline snapshot 8ea5e046-b1ce-4d44-ba51-da32fdc008fb of volume 60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:52:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[963be98c-0192-4825-b29b-6546dcac353e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:18 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea Jul 10 19:52:18 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:18 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea" returned: 0 in 0.985s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:18 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb 1G Jul 10 19:52:18 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:19 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb 1G" returned: 0 in 1.079s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f7123c-e869-455f-9e0a-284e9c7462ea -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:19 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f7123c-e869-455f-9e0a-284e9c7462ea -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb Jul 10 19:52:19 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:21 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f7123c-e869-455f-9e0a-284e9c7462ea -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb" returned: 0 in 1.095s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:21 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb is being set with open permissions: ugo+rw Jul 10 19:52:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:21 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb Jul 10 19:52:21 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:22 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb" returned: 0 in 1.196s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:22 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info Jul 10 19:52:22 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:23 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info" returned: 0 in 0.841s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:23 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info is being set with open permissions: ugo+rw Jul 10 19:52:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:23 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info Jul 10 19:52:23 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:24 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.info" returned: 0 in 1.189s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.569s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-25f8597c-a0c8-4f1d-b8c0-67736010b5e8 tempest-SnapshotMetadataTestJSON-1423227852 None] Create snapshot completed successfully Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "cinder-8ea5e046-b1ce-4d44-ba51-da32fdc008fb-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-8ea5e046-b1ce-4d44-ba51-da32fdc008fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "cinder-quobyte-60f7123c-e869-455f-9e0a-284e9c7462ea" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-quobyte-60f7123c-e869-455f-9e0a-284e9c7462ea" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "cinder-quobyte-8ea5e046-b1ce-4d44-ba51-da32fdc008fb" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-quobyte-8ea5e046-b1ce-4d44-ba51-da32fdc008fb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Deleting offline snapshot 8ea5e046-b1ce-4d44-ba51-da32fdc008fb of volume 60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] snapshot_file for this snap is: volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c71e9d-3fa4-4911-8ab8-0803fa4eaacc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:26 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb Jul 10 19:52:26 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:27 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb" returned: 0 in 0.800s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f7123c-e869-455f-9e0a-284e9c7462ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:52:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f4a24e-5bd2-47b8-aa1f-243de09479a3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:27 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea Jul 10 19:52:27 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:27 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea" returned: 0 in 0.783s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:27 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb Jul 10 19:52:27 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:28 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb" returned: 0 in 0.976s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:28 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb Jul 10 19:52:28 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:29 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea.8ea5e046-b1ce-4d44-ba51-da32fdc008fb" returned: 0 in 0.784s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-quobyte-8ea5e046-b1ce-4d44-ba51-da32fdc008fb" released by "_delete_snapshot" :: held 3.467s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-quobyte-60f7123c-e869-455f-9e0a-284e9c7462ea" released by "delete_snapshot" :: held 3.501s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:29 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Created reservations ['1c46b8d0-e4e6-4984-adb7-5fdc4461b1a3', '7423a372-9863-46d2-a859-d08338da2571', '4bd32998-feef-43ac-9a37-d277294fbff7', '9ece0131-e89f-4699-8453-54b176d5dc6f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:52:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Delete snapshot completed successfully. Jul 10 19:52:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0df58f3d-84ad-4e69-97e3-baab1e1326d8 tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-8ea5e046-b1ce-4d44-ba51-da32fdc008fb-delete_snapshot" released by "delete_snapshot" :: held 3.671s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "cinder-60f7123c-e869-455f-9e0a-284e9c7462ea-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-60f7123c-e869-455f-9e0a-284e9c7462ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "cinder-quobyte-60f7123c-e869-455f-9e0a-284e9c7462ea" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-quobyte-60f7123c-e869-455f-9e0a-284e9c7462ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b195d8c1-a17f-42d5-8812-16b77766d63a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:30 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea Jul 10 19:52:30 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:31 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea" returned: 0 in 0.747s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:31 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea Jul 10 19:52:31 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:32 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-60f7123c-e869-455f-9e0a-284e9c7462ea" returned: 0 in 0.674s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-quobyte-60f7123c-e869-455f-9e0a-284e9c7462ea" released by "delete_volume" :: held 1.500s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Created reservations ['6d740683-f75f-4664-bf53-b9416a56f659', 'f1b8727a-7cc7-44c5-bc9e-15f51fbf3cc7', '0daca83c-c8df-411a-90bc-7c11572b710c', '3e58c5f1-96ab-42c6-9696-a9b602e1f910'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:32 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:52:32 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:32 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.731s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:52:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Deleted volume successfully. Jul 10 19:52:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6bd483e-a00b-4886-afb2-afa86c29655b tempest-SnapshotMetadataTestJSON-1423227852 None] Lock "cinder-60f7123c-e869-455f-9e0a-284e9c7462ea-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Flow 'volume_create_manager' (cb404f51-1c67-4428-a9ed-64b1c2947289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455f0efe-2908-40a0-a03d-7e3399042d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455f0efe-2908-40a0-a03d-7e3399042d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-247164701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38c8cd4-5843-4ebf-8b56-e06984acee4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64cdc17a29f4dbbb032ae68bee18b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:36Z,use_quota=True,user_id='81c945a458e64ae5895c89fbec0d5489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08681a4-c99e-4fc8-bc75-611611795d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08681a4-c99e-4fc8-bc75-611611795d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa01d7e-0640-4c03-aa48-a6ee90135543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa01d7e-0640-4c03-aa48-a6ee90135543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38c8cd4-5843-4ebf-8b56-e06984acee4c', 'volume_name': 'volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b387c1-6c9c-47ac-ba1c-9e9da8ac964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b387c1-6c9c-47ac-ba1c-9e9da8ac964f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23b328-0b5e-4d19-b0ad-92e5b02fdd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:36 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Volume c38c8cd4-5843-4ebf-8b56-e06984acee4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c', 'volume_size': 1} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-247164701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38c8cd4-5843-4ebf-8b56-e06984acee4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64cdc17a29f4dbbb032ae68bee18b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:36Z,use_quota=True,user_id='81c945a458e64ae5895c89fbec0d5489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Creating volume c38c8cd4-5843-4ebf-8b56-e06984acee4c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:52:36 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:52:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:36 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c 1073741824 Jul 10 19:52:36 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:37 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c 1073741824" returned: 0 in 0.883s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:37 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c Jul 10 19:52:37 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:37 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:52:37 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:37 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23b328-0b5e-4d19-b0ad-92e5b02fdd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e08646-a462-4e8f-a7a1-9599bf0472db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:38 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Volume volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c (c38c8cd4-5843-4ebf-8b56-e06984acee4c): created successfully Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e08646-a462-4e8f-a7a1-9599bf0472db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Flow 'volume_create_manager' (cb404f51-1c67-4428-a9ed-64b1c2947289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d7dfbbf5-b197-4665-a8d7-390a2a68a5c2 tempest-AbsoluteLimitsTests-755663736 None] Created volume successfully. Jul 10 19:52:38 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.749s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Acquiring lock "cinder-c38c8cd4-5843-4ebf-8b56-e06984acee4c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Lock "cinder-c38c8cd4-5843-4ebf-8b56-e06984acee4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Acquiring lock "cinder-quobyte-c38c8cd4-5843-4ebf-8b56-e06984acee4c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Lock "cinder-quobyte-c38c8cd4-5843-4ebf-8b56-e06984acee4c" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c30f92-ed78-4f7c-a3bc-6e7b474e99f9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:38 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c Jul 10 19:52:38 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:39 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:39 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c Jul 10 19:52:39 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:40 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c38c8cd4-5843-4ebf-8b56-e06984acee4c" returned: 0 in 0.697s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Lock "cinder-quobyte-c38c8cd4-5843-4ebf-8b56-e06984acee4c" released by "delete_volume" :: held 1.542s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Created reservations ['b0af73c8-83c7-4d02-b756-34481a998d53', 'dcdd04b9-e193-4936-ac99-084969c8e062', 'a52496a0-7f74-422b-b034-eb9d7aea6ff3', '8e822bd5-d844-492d-af8f-565e9836fdf7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:40 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:52:40 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:41 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.702s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:41 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:52:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Deleted volume successfully. Jul 10 19:52:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-29fae596-b5e8-449d-9b40-19932f443e1f tempest-AbsoluteLimitsTests-755663736 None] Lock "cinder-c38c8cd4-5843-4ebf-8b56-e06984acee4c-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:45 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908a551-0fff-4138-aa9c-c1e27003562c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:45 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f Jul 10 19:52:45 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:46 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f" returned: 0 in 0.800s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afb99c9c-e32f-4c5b-bcea-4a85f397332f', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Flow 'volume_create_manager' (55f28496-38fc-4422-945b-b1c12501d062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cd868d-8460-47cd-9473-630b201a3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cd868d-8460-47cd-9473-630b201a3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1768310373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5affb5c-09d5-479a-8c9b-94b3513a3739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af890b321f31451fa67a231c14fc07ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:47Z,use_quota=True,user_id='3f7cedd4cb424f89b8fc26616b113cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8572e9-4997-433b-bec5-121f9cd765da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8572e9-4997-433b-bec5-121f9cd765da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e152a1-7fb1-4671-ab44-9ecdde63cbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e152a1-7fb1-4671-ab44-9ecdde63cbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5affb5c-09d5-479a-8c9b-94b3513a3739', 'volume_name': 'volume-d5affb5c-09d5-479a-8c9b-94b3513a3739', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ba302d-f79b-4f3b-8523-d43b3c126c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ba302d-f79b-4f3b-8523-d43b3c126c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1fe362-4229-4689-883f-c73708c32f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:46 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Volume d5affb5c-09d5-479a-8c9b-94b3513a3739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5affb5c-09d5-479a-8c9b-94b3513a3739', 'volume_size': 1} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1768310373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5affb5c-09d5-479a-8c9b-94b3513a3739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af890b321f31451fa67a231c14fc07ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:47Z,use_quota=True,user_id='3f7cedd4cb424f89b8fc26616b113cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Creating volume d5affb5c-09d5-479a-8c9b-94b3513a3739 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:52:46 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:52:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:46 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 1073741824 Jul 10 19:52:46 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-ca1d31bb-ffb9-48d6-b234-88a9d28445a7 req-dab89111-73c1-4403-a643-f01570aac162 tempest-TestServerVolumeAttachmentScenario-94194818 None] attachment_update completed successfully. Jul 10 19:52:47 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 1073741824" returned: 0 in 0.903s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:47 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 Jul 10 19:52:47 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:48 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739" returned: 0 in 0.682s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1fe362-4229-4689-883f-c73708c32f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5affb5c-09d5-479a-8c9b-94b3513a3739', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29472508-3e2c-4807-844a-2b63f8025eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:48 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Volume volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 (d5affb5c-09d5-479a-8c9b-94b3513a3739): created successfully Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29472508-3e2c-4807-844a-2b63f8025eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Flow 'volume_create_manager' (55f28496-38fc-4422-945b-b1c12501d062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9fdb49de-f70e-46f8-ab63-2a30cc235ef1 tempest-VolumesTransfersV357Test-2088218903 None] Created volume successfully. Jul 10 19:52:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8d710937-5381-4136-931c-2ccc5984ff7b tempest-VolumesTransfersV357Test-1105606681 None] Transfer volume completed successfully. Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Acquiring lock "cinder-d5affb5c-09d5-479a-8c9b-94b3513a3739-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-d5affb5c-09d5-479a-8c9b-94b3513a3739-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Acquiring lock "cinder-quobyte-d5affb5c-09d5-479a-8c9b-94b3513a3739" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-quobyte-d5affb5c-09d5-479a-8c9b-94b3513a3739" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2aea5a-4a92-4767-8e8c-1ee621c77ceb]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1410a9c-2668-4be2-9595-0a5ea9b8faff]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:50 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 Jul 10 19:52:50 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:50 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 Jul 10 19:52:50 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:51 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739" returned: 0 in 0.811s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:51 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739 Jul 10 19:52:51 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:51 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-1b94baee-9c50-411a-bea0-6be2c036a283', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd930ff7c-54d8-419e-a970-3540ee6c382f', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:52:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-4ef7d256-8633-41d2-b1dd-92755ea218f1 req-cfe1599d-07c3-4f0a-8546-0fd152adbdad tempest-TestStampPattern-1970690363 None] attachment_update completed successfully. Jul 10 19:52:51 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d5affb5c-09d5-479a-8c9b-94b3513a3739" returned: 0 in 0.710s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-quobyte-d5affb5c-09d5-479a-8c9b-94b3513a3739" released by "delete_volume" :: held 1.574s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Created reservations ['35e39026-0436-45ea-92a1-106671051564', '1ed44454-b97e-4729-9952-3df9860d9225', '81494e2f-bfe2-44fe-81e2-fa9000fb92c6', 'bc38b54a-587c-4687-b937-8369fb71a1b2'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:51 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:52:51 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:52 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.739s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:52:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Deleted volume successfully. Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18d5eaf0-1676-4202-b4ef-9b39262c1a8c tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-d5affb5c-09d5-479a-8c9b-94b3513a3739-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Flow 'volume_create_manager' (d7ce37e5-92ae-4e9e-956b-655192522dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfea68fd-6e20-4c2b-8801-b8db1633165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfea68fd-6e20-4c2b-8801-b8db1633165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1331292539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4480bc04-28d3-4652-9589-d28440ec26d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af890b321f31451fa67a231c14fc07ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:53Z,use_quota=True,user_id='3f7cedd4cb424f89b8fc26616b113cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c172af50-c6aa-48c9-a27d-e918a6a1a6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c172af50-c6aa-48c9-a27d-e918a6a1a6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ace95b1-85cc-4b88-8e5d-38b570bcbf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ace95b1-85cc-4b88-8e5d-38b570bcbf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4480bc04-28d3-4652-9589-d28440ec26d6', 'volume_name': 'volume-4480bc04-28d3-4652-9589-d28440ec26d6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dba54e6-3570-4b31-8217-7f9056cc7ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dba54e6-3570-4b31-8217-7f9056cc7ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184bf4c6-4de0-4d07-be72-448c009706f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:53 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Volume 4480bc04-28d3-4652-9589-d28440ec26d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4480bc04-28d3-4652-9589-d28440ec26d6', 'volume_size': 1} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1331292539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4480bc04-28d3-4652-9589-d28440ec26d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af890b321f31451fa67a231c14fc07ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:52:53Z,use_quota=True,user_id='3f7cedd4cb424f89b8fc26616b113cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Creating volume 4480bc04-28d3-4652-9589-d28440ec26d6 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:52:53 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:53 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 1073741824 Jul 10 19:52:53 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:53 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 1073741824" returned: 0 in 0.891s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:53 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 Jul 10 19:52:53 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:54 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184bf4c6-4de0-4d07-be72-448c009706f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4480bc04-28d3-4652-9589-d28440ec26d6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33208758-93e9-456d-8a2c-83dbd2e58a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:52:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Volume volume-4480bc04-28d3-4652-9589-d28440ec26d6 (4480bc04-28d3-4652-9589-d28440ec26d6): created successfully Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33208758-93e9-456d-8a2c-83dbd2e58a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:52:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Flow 'volume_create_manager' (d7ce37e5-92ae-4e9e-956b-655192522dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:52:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2beb5a69-b5ae-4005-a8cd-a4134ff9a2fd tempest-VolumesTransfersV357Test-2088218903 None] Created volume successfully. Jul 10 19:52:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Acquiring lock "cinder-4480bc04-28d3-4652-9589-d28440ec26d6-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-4480bc04-28d3-4652-9589-d28440ec26d6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Acquiring lock "cinder-quobyte-4480bc04-28d3-4652-9589-d28440ec26d6" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:52:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-quobyte-4480bc04-28d3-4652-9589-d28440ec26d6" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:52:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e84e8bc-6178-446b-b231-2cf9ad26cfff]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:55 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 Jul 10 19:52:55 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:56 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6" returned: 0 in 0.812s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:56 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6 Jul 10 19:52:56 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:56 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4480bc04-28d3-4652-9589-d28440ec26d6" returned: 0 in 0.665s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-quobyte-4480bc04-28d3-4652-9589-d28440ec26d6" released by "delete_volume" :: held 1.516s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Created reservations ['14278bbf-b521-4902-9945-efd4fcf05e9a', '8710e99e-8e09-47b2-8049-f722b5a13c71', '88fc75cf-a973-48aa-96fe-1bfae1d1aa68', '6ec60194-5a47-4589-b7b2-2ac29a1be28e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9ca8f-f3ee-4fac-9f7f-30efe4d78838]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:52:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:52:57 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:52:57 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:57 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 Jul 10 19:52:57 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:52:57 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.784s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:52:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Deleted volume successfully. Jul 10 19:52:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-f588bf39-03c6-45a8-91a0-fc0244fd0614 req-69f8298c-3212-45b3-acdd-7910ffdfbc1b tempest-TestStampPattern-1970690363 None] Terminate volume connection completed successfully. Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-f588bf39-03c6-45a8-91a0-fc0244fd0614 req-69f8298c-3212-45b3-acdd-7910ffdfbc1b tempest-TestStampPattern-1970690363 None] Deleting attachment d930ff7c-54d8-419e-a970-3540ee6c382f. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8a389e19-bae3-4471-9446-a9c94fcddca6 tempest-VolumesTransfersV357Test-2045925532 None] Lock "cinder-4480bc04-28d3-4652-9589-d28440ec26d6-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:52:57 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" returned: 0 in 0.925s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.943s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:52:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6', 'name': 'volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '350f0ee0-d5c8-49da-a779-302ce3e93c48', 'enforce_multipath': True} {{(pid=87164) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 19:52:58 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-cca0e0e8-99f2-430f-9134-f2508dd100c1 req-9d308980-095c-418a-ba85-b1d0a198db79 tempest-TestServerVolumeAttachmentScenario-94194818 None] attachment_update completed successfully. Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=66,cinder:UPDATE=69,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=75,cinder:INSERT=14,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Flow 'volume_create_manager' (e7bd10db-94d6-43c7-839c-2f53a2f21e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78293e89-9653-4707-8f12-cbaef7928a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78293e89-9653-4707-8f12-cbaef7928a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1374943784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851ea387-3f93-40bb-a8e1-018ffe085c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a73f265faf243b797de03c40bc1ad9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:03Z,use_quota=True,user_id='43cd4e0c43494e0dacddd810728b4e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c3bcc5-e368-479c-8b27-7b08064ece95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c3bcc5-e368-479c-8b27-7b08064ece95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205be29f-07d5-4413-9f47-2f5c8382b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205be29f-07d5-4413-9f47-2f5c8382b61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851ea387-3f93-40bb-a8e1-018ffe085c55', 'volume_name': 'volume-851ea387-3f93-40bb-a8e1-018ffe085c55', 'volume_size': 2}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e994b7-2147-467a-99bc-f23ecdab95de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e994b7-2147-467a-99bc-f23ecdab95de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67baaf8c-14a5-4f8d-951b-8cbe779bedc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:03 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Volume 851ea387-3f93-40bb-a8e1-018ffe085c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851ea387-3f93-40bb-a8e1-018ffe085c55', 'volume_size': 2} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1374943784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851ea387-3f93-40bb-a8e1-018ffe085c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a73f265faf243b797de03c40bc1ad9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:03Z,use_quota=True,user_id='43cd4e0c43494e0dacddd810728b4e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Creating volume 851ea387-3f93-40bb-a8e1-018ffe085c55 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:53:03 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 2147483648 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:03 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 2147483648 Jul 10 19:53:03 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:03 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-12f63cf2-39e5-4354-8deb-a1f9021ef13f req-0a659193-4cbe-4b09-9d3a-8e213609aac5 tempest-TestServerVolumeAttachmentScenario-94194818 None] Terminate volume connection completed successfully. Jul 10 19:53:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-12f63cf2-39e5-4354-8deb-a1f9021ef13f req-0a659193-4cbe-4b09-9d3a-8e213609aac5 tempest-TestServerVolumeAttachmentScenario-94194818 None] Deleting attachment 350f0ee0-d5c8-49da-a779-302ce3e93c48. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:53:04 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 2147483648" returned: 0 in 1.005s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:04 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 Jul 10 19:53:04 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:05 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55" returned: 0 in 0.680s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67baaf8c-14a5-4f8d-951b-8cbe779bedc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851ea387-3f93-40bb-a8e1-018ffe085c55', 'volume_size': 2}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c91aad-0412-4223-9ce4-11412f7b0252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Volume volume-851ea387-3f93-40bb-a8e1-018ffe085c55 (851ea387-3f93-40bb-a8e1-018ffe085c55): created successfully Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c91aad-0412-4223-9ce4-11412f7b0252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Flow 'volume_create_manager' (e7bd10db-94d6-43c7-839c-2f53a2f21e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dd92fdbe-066f-4c5e-aed8-273a59438859 tempest-VolumesCloneNegativeTest-1166899994 None] Created volume successfully. Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Acquiring lock "cinder-851ea387-3f93-40bb-a8e1-018ffe085c55-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Lock "cinder-851ea387-3f93-40bb-a8e1-018ffe085c55-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Acquiring lock "cinder-quobyte-851ea387-3f93-40bb-a8e1-018ffe085c55" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Lock "cinder-quobyte-851ea387-3f93-40bb-a8e1-018ffe085c55" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0b939-e82d-4c4e-ba64-9cbe7c9e6be9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:05 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 Jul 10 19:53:05 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:06 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55" returned: 0 in 0.849s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:06 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55 Jul 10 19:53:06 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:07 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-851ea387-3f93-40bb-a8e1-018ffe085c55" returned: 0 in 0.664s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Lock "cinder-quobyte-851ea387-3f93-40bb-a8e1-018ffe085c55" released by "delete_volume" :: held 1.555s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Created reservations ['c015a3f7-407b-4a6c-b4d0-0cf1c917ab28', 'bcc387dc-d12a-432a-adf4-886a66004e0e', '4767404d-73b4-4ae5-baaf-5ceb44026da6', '0598792b-6faf-4ebf-8f36-bff0592176a1'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:07 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:07 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:07 devstack cinder-volume[87164]: INFO cinder.volume.manager [req-0e9e0268-3345-4dd2-b8e7-a63c65a60028 req-fbc00bd0-1e79-4a2a-ad09-75ff2e15bcdb tempest-TestServerVolumeAttachmentScenario-94194818 None] Terminate volume connection completed successfully. Jul 10 19:53:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [req-0e9e0268-3345-4dd2-b8e7-a63c65a60028 req-fbc00bd0-1e79-4a2a-ad09-75ff2e15bcdb tempest-TestServerVolumeAttachmentScenario-94194818 None] Deleting attachment afb99c9c-e32f-4c5b-bcea-4a85f397332f. {{(pid=87164) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 19:53:08 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Deleted volume successfully. Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b992ac-ba66-4b57-8069-1a5f882b2b4c tempest-VolumesCloneNegativeTest-1166899994 None] Lock "cinder-851ea387-3f93-40bb-a8e1-018ffe085c55-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-1b94baee-9c50-411a-bea0-6be2c036a283-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Lock "cinder-1b94baee-9c50-411a-bea0-6be2c036a283-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-quobyte-1b94baee-9c50-411a-bea0-6be2c036a283" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-1b94baee-9c50-411a-bea0-6be2c036a283" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0253269-6b28-4e57-920d-b6826e64d5ea]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:08 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 Jul 10 19:53:08 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:09 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283" returned: 0 in 0.881s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:09 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283 Jul 10 19:53:09 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:09 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1b94baee-9c50-411a-bea0-6be2c036a283" returned: 0 in 0.695s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-1b94baee-9c50-411a-bea0-6be2c036a283" released by "delete_volume" :: held 1.628s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Created reservations ['17453357-1ba8-4cb0-a70e-13701243bf4d', '050970e3-90c8-42b4-9c9f-83b1773be832', 'ebbfb762-2f72-4e2d-a641-ca1842cc7fb3', 'fe099197-dad1-4402-a045-df3414503aa6'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:10 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:10 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-0808ca1c-8d23-4b29-ba16-864ee85a113c-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:10 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Lock "cinder-0808ca1c-8d23-4b29-ba16-864ee85a113c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-quobyte-c3df5a4e-2294-450e-8d79-622e3569df75" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Deleted volume successfully. Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-c3df5a4e-2294-450e-8d79-622e3569df75" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-quobyte-0808ca1c-8d23-4b29-ba16-864ee85a113c" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8ea162ef-86e5-47fb-bbd7-a55cd424786f tempest-TestStampPattern-1970690363 None] Lock "cinder-1b94baee-9c50-411a-bea0-6be2c036a283-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-0808ca1c-8d23-4b29-ba16-864ee85a113c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Deleting offline snapshot 0808ca1c-8d23-4b29-ba16-864ee85a113c of volume c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:53:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] snapshot_file for this snap is: volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[24091ee5-b822-4077-a293-2722b8032117]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:11 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c Jul 10 19:53:11 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Flow 'volume_create_manager' (55c35759-0d04-4065-9432-524364701189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b9bdb1-0a31-4c53-abc7-357bbb8fe85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b9bdb1-0a31-4c53-abc7-357bbb8fe85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1733502455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328eaa9a-f688-46eb-a952-9b0d083262f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac0ca824bc645f59adf6d0c8b4176ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:11Z,use_quota=True,user_id='f043bf27570d42ae994cacf087bd376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1690165-bc2b-40c0-9fcb-333dc2602a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1690165-bc2b-40c0-9fcb-333dc2602a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d1afba-a077-40d4-8dbe-322687cf8e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d1afba-a077-40d4-8dbe-322687cf8e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '328eaa9a-f688-46eb-a952-9b0d083262f3', 'volume_name': 'volume-328eaa9a-f688-46eb-a952-9b0d083262f3', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945e0f97-a221-41f4-b6e5-ad1b12fcbeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945e0f97-a221-41f4-b6e5-ad1b12fcbeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6f3b73-4285-4b8c-8c44-ef360c4c41c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:11 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Volume 328eaa9a-f688-46eb-a952-9b0d083262f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-328eaa9a-f688-46eb-a952-9b0d083262f3', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Trying to clone 328eaa9a-f688-46eb-a952-9b0d083262f3 from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:53:11 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c" returned: 0 in 0.940s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3df5a4e-2294-450e-8d79-622e3569df75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0253730-9556-4f86-a03b-5c3980c01781]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:12 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:53:12 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:53:12 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Image download 20.69 MB at 20.69 MB/s Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca531a0-7a2f-466f-a032-c960df358865]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:12 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD Jul 10 19:53:12 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:12 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 0.872s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:12 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c Jul 10 19:53:12 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:13 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:13 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f is fetched for user f043bf27570d42ae994cacf087bd376f. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:53:13 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd53a430-c17c-4bee-b79b-3dcb25a36bd3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:13 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD Jul 10 19:53:13 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:13 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c" returned: 0 in 0.900s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:13 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c Jul 10 19:53:13 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:14 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1733502455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328eaa9a-f688-46eb-a952-9b0d083262f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac0ca824bc645f59adf6d0c8b4176ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:11Z,use_quota=True,user_id='f043bf27570d42ae994cacf087bd376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Creating volume 328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:53:14 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:14 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 1073741824 Jul 10 19:53:14 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:14 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75.0808ca1c-8d23-4b29-ba16-864ee85a113c" returned: 0 in 0.687s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-0808ca1c-8d23-4b29-ba16-864ee85a113c" released by "_delete_snapshot" :: held 3.565s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-c3df5a4e-2294-450e-8d79-622e3569df75" released by "delete_snapshot" :: held 3.593s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Created reservations ['10b6ff02-5e0a-41b1-a2b4-46d61f8b1c93', '8b235ff8-f1d7-4e30-95af-dbde9564bb31', '81f8accf-95a9-438a-9281-be4c367f8a9e', '428f3b21-8b10-4739-839b-578727c5760a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Delete snapshot completed successfully. Jul 10 19:53:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4cc6e05f-c971-4c5f-926b-192bebfa517f tempest-TestStampPattern-1970690363 None] Lock "cinder-0808ca1c-8d23-4b29-ba16-864ee85a113c-delete_snapshot" released by "delete_snapshot" :: held 3.738s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:15 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 1073741824" returned: 0 in 0.845s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:15 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:15 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:15 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 0 in 0.741s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Attempting download of f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume 328eaa9a-f688-46eb-a952-9b0d083262f3. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd347c94-82e5-439c-987d-0d71eb39703e]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:16 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8 Jul 10 19:53:16 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:16 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8" returned: 0 in 0.763s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:16 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8 Jul 10 19:53:16 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:17 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8" returned: 1 in 0.802s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_ao5e03w8' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9259fa3c-cf3e-4423-91e4-5b4e3e48d9be]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:17 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD Jul 10 19:53:17 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:18 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD" returned: 0 in 0.944s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:18 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] f6bf008e-8dc3-4605-a3ec-36b1ff11d65f was qcow2, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:53:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:18 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:18 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "cinder-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "cinder-quobyte-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-quobyte-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f70437-356f-4457-8b3a-47add2fec774]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:19 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 Jul 10 19:53:19 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:20 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" returned: 0 in 0.823s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:20 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995 Jul 10 19:53:20 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:20 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 0 in 2.089s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6bf008e-8dc3-4605-a3ec-36b1ff11d65f_w2pzqzgedevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:53:20 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Converted 112.00 MB image at 53.58 MB/s Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:20 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 1G Jul 10 19:53:20 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:20 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" returned: 0 in 0.728s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-quobyte-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995" released by "delete_volume" :: held 1.604s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:20 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Created reservations ['ed1f7e48-408d-43b3-9733-4a148db2e2c7', '204b67e6-070f-4808-babc-55b38e082328', '7cffadae-b870-432d-8c4a-1122f6385eac', '276ff088-d34b-45c0-a183-a7fa0c8d7c31'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:21 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:21 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:21 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 1G" returned: 0 in 0.718s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6399a2ed-1282-46be-9f74-5c1d10891bff]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "cinder-31cfd328-8328-4acf-9dc6-a2b238a8c12f-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-31cfd328-8328-4acf-9dc6-a2b238a8c12f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:21 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:21 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "cinder-quobyte-31cfd328-8328-4acf-9dc6-a2b238a8c12f" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-quobyte-31cfd328-8328-4acf-9dc6-a2b238a8c12f" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e683f-2bc8-4007-bc8d-d417374699c1]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:21 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.701s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Deleted volume successfully. Jul 10 19:53:21 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f Jul 10 19:53:21 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84d58efd-5cac-4d0b-b78b-1f628c7faf91 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-b0d1f7d6-4c6f-42e6-a1f6-5cc20906a995-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:22 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 0 in 0.900s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:22 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:22 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:22 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f" returned: 0 in 0.806s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:22 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f Jul 10 19:53:22 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-c3df5a4e-2294-450e-8d79-622e3569df75-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Lock "cinder-c3df5a4e-2294-450e-8d79-622e3569df75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Acquiring lock "cinder-quobyte-c3df5a4e-2294-450e-8d79-622e3569df75" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-c3df5a4e-2294-450e-8d79-622e3569df75" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e49a0-b45a-4bd1-a6e8-3c7229faf55a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:23 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:53:23 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:23 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-31cfd328-8328-4acf-9dc6-a2b238a8c12f" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:23 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-quobyte-31cfd328-8328-4acf-9dc6-a2b238a8c12f" released by "delete_volume" :: held 1.534s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 1 in 0.874s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Downloaded image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f ((None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}])) to volume 328eaa9a-f688-46eb-a952-9b0d083262f3 successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Temporary image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f for user f043bf27570d42ae994cacf087bd376f is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Marking volume 328eaa9a-f688-46eb-a952-9b0d083262f3 as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Copying metadata from image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f to 328eaa9a-f688-46eb-a952-9b0d083262f3. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Creating volume glance metadata for volume 328eaa9a-f688-46eb-a952-9b0d083262f3 backed by image f6bf008e-8dc3-4605-a3ec-36b1ff11d65f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Created reservations ['41889919-6234-432c-ac16-fc25b5e5bc54', 'f47ade35-db9c-468e-88e3-8234408f7158', '6f2f03ae-5172-4c6a-af2a-e2fc49cdaf0a', 'b452aabb-6e94-4775-96c8-a097a87311d7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6f3b73-4285-4b8c-8c44-ef360c4c41c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328eaa9a-f688-46eb-a952-9b0d083262f3', 'volume_size': 1, 'image_id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77c2578ce4684f82a5d1cdcbd5784c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6bf008e-8dc3-4605-a3ec-36b1ff11d65f', 'created_at': datetime.datetime(2026, 7, 10, 17, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 29, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6bf008e-8dc3-4605-a3ec-36b1ff11d65f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df137ccf-b3ea-483d-9f4c-77ae5c31220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Volume volume-328eaa9a-f688-46eb-a952-9b0d083262f3 (328eaa9a-f688-46eb-a952-9b0d083262f3): created successfully Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df137ccf-b3ea-483d-9f4c-77ae5c31220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Flow 'volume_create_manager' (55c35759-0d04-4065-9432-524364701189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:23 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cfd79261-0816-4b85-9d30-2d16086cdb6d tempest-VolumesExtendTest-585211235 None] Created volume successfully. Jul 10 19:53:23 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:23 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:23 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 0.787s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:23 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75 Jul 10 19:53:23 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:23 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.678s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:23 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Deleted volume successfully. Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4f901789-af99-4ccd-ab2d-7a2117e6fc64 tempest-TestServerVolumeAttachmentScenario-94194818 None] Lock "cinder-31cfd328-8328-4acf-9dc6-a2b238a8c12f-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:24 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c3df5a4e-2294-450e-8d79-622e3569df75" returned: 0 in 0.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Lock "cinder-quobyte-c3df5a4e-2294-450e-8d79-622e3569df75" released by "delete_volume" :: held 1.593s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1de2251-d0d6-444f-896f-194f8994f454]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Created reservations ['c98e51e2-e328-423e-a029-0bc41199ae05', '0e665504-4d7e-49bc-b549-e3f5b19c380e', '776f4d67-8489-493d-92c2-36320eff843c', '613f464f-0d93-4f9f-bafc-62c5f49c189c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:24 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:24 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:24 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:24 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:25 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 0 in 0.884s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:25 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.806s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:25 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Deleted volume successfully. Jul 10 19:53:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5ffd091f-3df0-4402-91fd-979887a529cb tempest-TestStampPattern-1970690363 None] Lock "cinder-c3df5a4e-2294-450e-8d79-622e3569df75-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:25 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:25 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:26 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 1 in 0.867s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 2G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 2G" returned: 0 in 0.121s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.950s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-54a4d587-3603-4aa9-91b1-c03817457b7e tempest-VolumesExtendTest-585211235 None] Extend volume completed successfully. Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-328eaa9a-f688-46eb-a952-9b0d083262f3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Lock "cinder-328eaa9a-f688-46eb-a952-9b0d083262f3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-quobyte-328eaa9a-f688-46eb-a952-9b0d083262f3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-328eaa9a-f688-46eb-a952-9b0d083262f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38858e-13c0-473b-95dc-7056913d03c8]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:27 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:27 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:27 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 0 in 0.845s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:28 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:28 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:28 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 1 in 0.898s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:28 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3 Jul 10 19:53:28 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:29 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-328eaa9a-f688-46eb-a952-9b0d083262f3" returned: 0 in 0.883s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-328eaa9a-f688-46eb-a952-9b0d083262f3" released by "delete_volume" :: held 2.705s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Created reservations ['f8b6d2ca-7320-45e8-834a-dd5836b01582', 'e34c2983-d699-4543-ba69-4fda3f98a58c', '60d7195e-56ad-4da0-a8e5-89a4dbdc0630', 'f1ac7095-c72c-4cc0-91eb-9ab744b2458d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:29 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:29 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:30 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Deleted volume successfully. Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Flow 'volume_create_manager' (9884a2ca-2cdc-4d88-a48e-f8302a5966e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7851072-1f40-4e7b-875d-f775015d5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6f18581-d654-42d6-9519-8a1aa0adf8dc tempest-VolumesExtendTest-585211235 None] Lock "cinder-328eaa9a-f688-46eb-a952-9b0d083262f3-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7851072-1f40-4e7b-875d-f775015d5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1781486419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6943796b-3869-4c1a-9642-a0b26c6279a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac0ca824bc645f59adf6d0c8b4176ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:31Z,use_quota=True,user_id='f043bf27570d42ae994cacf087bd376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c30908-bc34-4acb-b8ad-d644ef09b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c30908-bc34-4acb-b8ad-d644ef09b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33655c2d-0897-432f-855a-d9e255a414a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33655c2d-0897-432f-855a-d9e255a414a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6943796b-3869-4c1a-9642-a0b26c6279a7', 'volume_name': 'volume-6943796b-3869-4c1a-9642-a0b26c6279a7', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2bfae2-364f-467f-b8ef-0eedbaa2f712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2bfae2-364f-467f-b8ef-0eedbaa2f712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce2713a-3e5a-40d5-9bef-b4b81d95e53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:30 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Volume 6943796b-3869-4c1a-9642-a0b26c6279a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6943796b-3869-4c1a-9642-a0b26c6279a7', 'volume_size': 1} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1781486419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6943796b-3869-4c1a-9642-a0b26c6279a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac0ca824bc645f59adf6d0c8b4176ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:31Z,use_quota=True,user_id='f043bf27570d42ae994cacf087bd376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Creating volume 6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:53:30 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:53:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:31 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 1073741824 Jul 10 19:53:31 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:32 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 1073741824" returned: 0 in 1.047s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:32 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 Jul 10 19:53:32 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:32 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce2713a-3e5a-40d5-9bef-b4b81d95e53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6943796b-3869-4c1a-9642-a0b26c6279a7', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87babca5-bcd8-4059-8f10-9b057ffe1a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Volume volume-6943796b-3869-4c1a-9642-a0b26c6279a7 (6943796b-3869-4c1a-9642-a0b26c6279a7): created successfully Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87babca5-bcd8-4059-8f10-9b057ffe1a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Flow 'volume_create_manager' (9884a2ca-2cdc-4d88-a48e-f8302a5966e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c83e7ec8-24dd-48b7-8bc5-49f4462a93c7 tempest-VolumesExtendTest-585211235 None] Created volume successfully. Jul 10 19:53:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Creating offline snapshot b497aebf-e145-44ba-b0b9-f636d5c475a4 of volume 6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:53:34 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ccbb50-d16c-4553-aa22-c5c60b55b16a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:34 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 Jul 10 19:53:34 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:35 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7" returned: 0 in 0.904s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:35 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 1G Jul 10 19:53:35 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:36 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 1G" returned: 0 in 0.929s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6943796b-3869-4c1a-9642-a0b26c6279a7 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:36 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6943796b-3869-4c1a-9642-a0b26c6279a7 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 Jul 10 19:53:36 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:37 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6943796b-3869-4c1a-9642-a0b26c6279a7 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4" returned: 0 in 0.839s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:37 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 is being set with open permissions: ugo+rw Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:37 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 Jul 10 19:53:37 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:37 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:37 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:37 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4" returned: 0 in 0.829s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:37 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info Jul 10 19:53:37 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:38 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.874s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:53:38 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info" returned: 0 in 0.828s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:38 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info is being set with open permissions: ugo+rw Jul 10 19:53:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:38 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info Jul 10 19:53:38 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:39 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.info" returned: 0 in 0.804s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.242s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:39 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b97a3b92-1735-446d-8644-4e2fa093b4d7 tempest-VolumesExtendTest-585211235 None] Create snapshot completed successfully Jul 10 19:53:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58feb8-88d2-487f-8856-4ab6fee3181e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:40 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 Jul 10 19:53:40 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:41 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 2G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 2G" returned: 0 in 0.160s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.043s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9de46dbf-abe4-4b2e-b52e-24c79fde8bc2 tempest-VolumesExtendTest-585211235 None] Extend volume completed successfully. Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Flow 'volume_create_manager' (2d3aeb4a-5b07-4d56-9108-537725c6643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658d30bb-aa61-4cb9-bde6-2621168130df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658d30bb-aa61-4cb9-bde6-2621168130df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06653b23-8496-4094-b85d-d0bc4f7fbdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbe5c21169b4a62909484623423d101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:42Z,use_quota=True,user_id='56ae885577214254a3c60e5e0c71cf9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(503394c0-2c53-4f21-8a94-93699ea66e99),volume_type_id=503394c0-2c53-4f21-8a94-93699ea66e99)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344cd739-d09a-40ab-81a1-22da05e80ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344cd739-d09a-40ab-81a1-22da05e80ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24daab49-0593-4dfd-ba72-770061a9c1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24daab49-0593-4dfd-ba72-770061a9c1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06653b23-8496-4094-b85d-d0bc4f7fbdbe', 'volume_name': 'volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe', 'volume_size': 1, 'image_id': '139b18ac-d254-4052-b388-e68d78084031', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/139b18ac-d254-4052-b388-e68d78084031', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f00c3758b390aa67e49cac59ec509e22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0bbe5c21169b4a62909484623423d101', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2d782bf48457d97462d7aaee5b0cdbfea72129520eaeb809cbe5633ea604f0c430175318bcab8f1cc1296f13240f49e7a4a95129a24fa2c9305440836e96bfe', 'id': '139b18ac-d254-4052-b388-e68d78084031', 'created_at': datetime.datetime(2026, 7, 10, 17, 53, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 53, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/139b18ac-d254-4052-b388-e68d78084031/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f7aa04-bc98-4de5-b8d0-9ee94caf3161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f7aa04-bc98-4de5-b8d0-9ee94caf3161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d812b-abf7-4772-8015-c31d3159ddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:42 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Volume 06653b23-8496-4094-b85d-d0bc4f7fbdbe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe', 'volume_size': 1, 'image_id': '139b18ac-d254-4052-b388-e68d78084031', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/139b18ac-d254-4052-b388-e68d78084031', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f00c3758b390aa67e49cac59ec509e22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0bbe5c21169b4a62909484623423d101', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2d782bf48457d97462d7aaee5b0cdbfea72129520eaeb809cbe5633ea604f0c430175318bcab8f1cc1296f13240f49e7a4a95129a24fa2c9305440836e96bfe', 'id': '139b18ac-d254-4052-b388-e68d78084031', 'created_at': datetime.datetime(2026, 7, 10, 17, 53, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 53, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/139b18ac-d254-4052-b388-e68d78084031/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Trying to clone 06653b23-8496-4094-b85d-d0bc4f7fbdbe from image 139b18ac-d254-4052-b388-e68d78084031 at location (None, [{'url': 'file:///opt/stack/data/glance/images/139b18ac-d254-4052-b388-e68d78084031', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:53:42 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Image download 0.00 MB at 0.00 MB/s Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0fee80-5389-4466-b022-f90da790f72c]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-b497aebf-e145-44ba-b0b9-f636d5c475a4-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Lock "cinder-b497aebf-e145-44ba-b0b9-f636d5c475a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-quobyte-6943796b-3869-4c1a-9642-a0b26c6279a7" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-6943796b-3869-4c1a-9642-a0b26c6279a7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-quobyte-b497aebf-e145-44ba-b0b9-f636d5c475a4" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:43 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD Jul 10 19:53:43 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-b497aebf-e145-44ba-b0b9-f636d5c475a4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Deleting offline snapshot b497aebf-e145-44ba-b0b9-f636d5c475a4 of volume 6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] snapshot_file for this snap is: volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[529eb0b3-7f53-4668-8735-ff40c8978a38]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:43 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 Jul 10 19:53:43 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:43 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:43 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD Jul 10 19:53:43 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:43 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4" returned: 0 in 0.774s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6943796b-3869-4c1a-9642-a0b26c6279a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f709db-2e99-49e6-aade-73db8e7bc155]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:44 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 Jul 10 19:53:44 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:44 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD" returned: 1 in 0.754s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Temporary image 139b18ac-d254-4052-b388-e68d78084031 is fetched for user 56ae885577214254a3c60e5e0c71cf9f. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e8ebad-e5ef-445c-a837-d50ec905ebc5]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:44 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD Jul 10 19:53:44 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:44 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:44 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 Jul 10 19:53:44 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:45 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:45 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD Jul 10 19:53:45 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:45 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4" returned: 0 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:45 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4 Jul 10 19:53:45 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:46 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06653b23-8496-4094-b85d-d0bc4f7fbdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbe5c21169b4a62909484623423d101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:42Z,use_quota=True,user_id='56ae885577214254a3c60e5e0c71cf9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(503394c0-2c53-4f21-8a94-93699ea66e99),volume_type_id=503394c0-2c53-4f21-8a94-93699ea66e99)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Creating volume 06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:53:46 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:46 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe 1073741824 Jul 10 19:53:46 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:46 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7.b497aebf-e145-44ba-b0b9-f636d5c475a4" returned: 0 in 0.667s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-b497aebf-e145-44ba-b0b9-f636d5c475a4" released by "_delete_snapshot" :: held 3.144s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-6943796b-3869-4c1a-9642-a0b26c6279a7" released by "delete_snapshot" :: held 3.171s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Created reservations ['18d30c15-2517-4f64-8c07-78bdfdaaaf18', '3478f4c8-1906-41b1-a2d7-ca52450ad739', '61f4e0c5-7b71-4151-8a7b-beef9b8e92ec', '4cf9a807-fff7-4a45-92c8-286555788cbc'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Delete snapshot completed successfully. Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d299c5c0-f1e6-4edc-b3bc-b9f5d77dc0f2 tempest-VolumesExtendTest-585211235 None] Lock "cinder-b497aebf-e145-44ba-b0b9-f636d5c475a4-delete_snapshot" released by "delete_snapshot" :: held 3.308s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:46 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe 1073741824" returned: 0 in 0.853s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:46 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:46 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-6943796b-3869-4c1a-9642-a0b26c6279a7-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Lock "cinder-6943796b-3869-4c1a-9642-a0b26c6279a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Acquiring lock "cinder-quobyte-6943796b-3869-4c1a-9642-a0b26c6279a7" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-6943796b-3869-4c1a-9642-a0b26c6279a7" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[528685ac-4c14-44f6-95a3-b3415181a5d2]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:47 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 Jul 10 19:53:47 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:47 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 0 in 0.684s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Attempting download of 139b18ac-d254-4052-b388-e68d78084031 ((None, [{'url': 'file:///opt/stack/data/glance/images/139b18ac-d254-4052-b388-e68d78084031', 'metadata': {}}])) to volume 06653b23-8496-4094-b85d-d0bc4f7fbdbe. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd5c65-924e-4ea3-b373-a2c65610d1f4]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:47 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn Jul 10 19:53:47 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:48 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7" returned: 0 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:48 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7 Jul 10 19:53:48 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:48 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn" returned: 0 in 0.769s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:48 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn Jul 10 19:53:48 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:48 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6943796b-3869-4c1a-9642-a0b26c6279a7" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Lock "cinder-quobyte-6943796b-3869-4c1a-9642-a0b26c6279a7" released by "delete_volume" :: held 1.521s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Created reservations ['b8eca3b6-1738-44e7-9b77-df25b35a9797', '86e1bf49-f75b-49d9-baf3-cd9dc0d233e2', '867c2c1e-7b7d-44b9-aa65-ace84f1f59b2', '3eec229d-befe-44f9-bfe4-e466bbecf50f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:49 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:49 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:49 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn" returned: 1 in 0.742s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_139b18ac-d254-4052-b388-e68d78084031_te2h39cn' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[43873896-5f78-4ef7-b851-82bf8e66d6c2]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:49 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD Jul 10 19:53:49 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:49 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.672s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Deleted volume successfully. Jul 10 19:53:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c49086c6-8909-4582-96ba-6a5d64a931b8 tempest-VolumesExtendTest-585211235 None] Lock "cinder-6943796b-3869-4c1a-9642-a0b26c6279a7-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:50 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:50 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD Jul 10 19:53:50 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:50 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD" returned: 1 in 0.775s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:50 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] 139b18ac-d254-4052-b388-e68d78084031 was raw, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:53:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:50 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:50 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:51 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 0 in 0.765s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:51 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_139b18ac-d254-4052-b388-e68d78084031_h2i60c2rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:53:51 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 19:53:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:51 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe 1G Jul 10 19:53:51 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:52 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe 1G" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57baaf3-7121-42ac-b339-dda50d8cdce6]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Flow 'volume_create_manager' (58a07ad4-1331-4cb9-83bb-5da8e56dffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c57732-dc40-4f5c-8afe-86bd777ff3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c57732-dc40-4f5c-8afe-86bd777ff3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094724905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762b1e07-05ae-4943-9227-3d8924b6dcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664f1fee1112492ea6cf40c36a781e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:52Z,use_quota=True,user_id='2065f3bce2a14f10af2badebbfbe20e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cf5541-40b6-4724-b344-09f8e9d1e0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cf5541-40b6-4724-b344-09f8e9d1e0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37a5927-2db5-4c6f-a96c-e71ed25c0441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:52 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:52 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37a5927-2db5-4c6f-a96c-e71ed25c0441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762b1e07-05ae-4943-9227-3d8924b6dcdf', 'volume_name': 'volume-762b1e07-05ae-4943-9227-3d8924b6dcdf', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644f04db-b4e6-4a08-a6b6-a0e5f0ef6ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644f04db-b4e6-4a08-a6b6-a0e5f0ef6ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3f4120-7d50-4d49-90d0-ef4362b80da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Volume 762b1e07-05ae-4943-9227-3d8924b6dcdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762b1e07-05ae-4943-9227-3d8924b6dcdf', 'volume_size': 1} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094724905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762b1e07-05ae-4943-9227-3d8924b6dcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664f1fee1112492ea6cf40c36a781e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:53:52Z,use_quota=True,user_id='2065f3bce2a14f10af2badebbfbe20e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Creating volume 762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:53:52 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:53:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:52 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf 1073741824 Jul 10 19:53:52 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:53 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 0 in 0.798s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:53 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:53 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:53 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf 1073741824" returned: 0 in 0.902s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:53 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:53:53 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:53 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 1 in 0.790s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Downloaded image 139b18ac-d254-4052-b388-e68d78084031 ((None, [{'url': 'file:///opt/stack/data/glance/images/139b18ac-d254-4052-b388-e68d78084031', 'metadata': {}}])) to volume 06653b23-8496-4094-b85d-d0bc4f7fbdbe successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Temporary image 139b18ac-d254-4052-b388-e68d78084031 for user 56ae885577214254a3c60e5e0c71cf9f is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Marking volume 06653b23-8496-4094-b85d-d0bc4f7fbdbe as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Copying metadata from image 139b18ac-d254-4052-b388-e68d78084031 to 06653b23-8496-4094-b85d-d0bc4f7fbdbe. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:53:53 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Creating volume glance metadata for volume 06653b23-8496-4094-b85d-d0bc4f7fbdbe backed by image 139b18ac-d254-4052-b388-e68d78084031 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '139b18ac-d254-4052-b388-e68d78084031', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f00c3758b390aa67e49cac59ec509e22', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d812b-abf7-4772-8015-c31d3159ddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe', 'volume_size': 1, 'image_id': '139b18ac-d254-4052-b388-e68d78084031', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/139b18ac-d254-4052-b388-e68d78084031', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f00c3758b390aa67e49cac59ec509e22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0bbe5c21169b4a62909484623423d101', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2d782bf48457d97462d7aaee5b0cdbfea72129520eaeb809cbe5633ea604f0c430175318bcab8f1cc1296f13240f49e7a4a95129a24fa2c9305440836e96bfe', 'id': '139b18ac-d254-4052-b388-e68d78084031', 'created_at': datetime.datetime(2026, 7, 10, 17, 53, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 53, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/139b18ac-d254-4052-b388-e68d78084031/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb06497-fde9-4d6a-8506-30adeaac8361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Volume volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe (06653b23-8496-4094-b85d-d0bc4f7fbdbe): created successfully Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb06497-fde9-4d6a-8506-30adeaac8361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Flow 'volume_create_manager' (2d3aeb4a-5b07-4d56-9108-537725c6643a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ad13e3a7-a0c7-4780-84f2-0408bead7b07 tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Created volume successfully. Jul 10 19:53:54 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.695s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3f4120-7d50-4d49-90d0-ef4362b80da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762b1e07-05ae-4943-9227-3d8924b6dcdf', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaa2ffc-57f2-416a-b3ee-8e721d0ebfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:53:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Volume volume-762b1e07-05ae-4943-9227-3d8924b6dcdf (762b1e07-05ae-4943-9227-3d8924b6dcdf): created successfully Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaa2ffc-57f2-416a-b3ee-8e721d0ebfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Flow 'volume_create_manager' (58a07ad4-1331-4cb9-83bb-5da8e56dffd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:53:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dfdb81e7-2527-486c-9678-6e52e4de2997 tempest-VolumeDependencyTests-1808544073 None] Created volume successfully. Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Creating offline snapshot 3ab7912c-0f4b-47ab-9e05-b989a5522788 of volume 762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb07038-e989-47c4-ae25-834e28a84239]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:54 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:53:54 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Acquiring lock "cinder-06653b23-8496-4094-b85d-d0bc4f7fbdbe-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "cinder-06653b23-8496-4094-b85d-d0bc4f7fbdbe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Acquiring lock "cinder-quobyte-06653b23-8496-4094-b85d-d0bc4f7fbdbe" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "cinder-quobyte-06653b23-8496-4094-b85d-d0bc4f7fbdbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121f992-8a24-4f04-8210-100093ffd02a]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:55 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:55 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:55 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.819s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:55 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 1G Jul 10 19:53:55 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:56 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 0 in 0.794s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:56 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:56 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:56 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 1G" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-762b1e07-05ae-4943-9227-3d8924b6dcdf -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:56 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-762b1e07-05ae-4943-9227-3d8924b6dcdf -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 Jul 10 19:53:56 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:56 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 1 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:53:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:56 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe Jul 10 19:53:56 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:57 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-762b1e07-05ae-4943-9227-3d8924b6dcdf -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788" returned: 0 in 0.717s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:57 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 is being set with open permissions: ugo+rw Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:57 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 Jul 10 19:53:57 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:57 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-06653b23-8496-4094-b85d-d0bc4f7fbdbe" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "cinder-quobyte-06653b23-8496-4094-b85d-d0bc4f7fbdbe" released by "delete_volume" :: held 2.342s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:57 devstack cinder-volume[87164]: WARNING cinder.quota [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:53:57 devstack cinder-volume[87164]: WARNING cinder.quota [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Created reservations ['32fb5165-12bc-4f6a-a6de-10fe8c9bf5c3', 'ed245a1d-39c3-4bf5-afc9-9a10f5262b24', '15a53506-db0a-45ab-86d6-a74332f31f1c', 'bd52908e-b3b7-4db6-bb7e-fd307b8da071'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:53:57 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:57 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info Jul 10 19:53:57 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:57 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:53:57 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:58 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:58 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info" returned: 0 in 0.703s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:58 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info is being set with open permissions: ugo+rw Jul 10 19:53:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:53:58 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:53:58 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Deleted volume successfully. Jul 10 19:53:58 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info Jul 10 19:53:58 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:53:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e6e109e5-6a20-4a9f-bba2-0d01adba098e tempest-VolumeAndVolumeTypeFromImageTest-1503717717 None] Lock "cinder-06653b23-8496-4094-b85d-d0bc4f7fbdbe-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:53:59 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 10 19:53:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.info" returned: 0 in 0.699s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:53:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.552s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:53:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-17daada3-1d16-44f6-b8a2-2a44ab04b1fd tempest-VolumeDependencyTests-1808544073 None] Create snapshot completed successfully Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Flow 'volume_create_manager' (9ea31092-43b1-4179-a683-84cbc56f35df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22dfae99-5105-455b-ab61-11333f18787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22dfae99-5105-455b-ab61-11333f18787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-543799076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664f1fee1112492ea6cf40c36a781e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ab7912c-0f4b-47ab-9e05-b989a5522788,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:00Z,use_quota=True,user_id='2065f3bce2a14f10af2badebbfbe20e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6def0a64-5a9b-48c7-983e-04eb4cfa51bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6def0a64-5a9b-48c7-983e-04eb4cfa51bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30de19d8-fcf6-407a-a446-4a035c951c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30de19d8-fcf6-407a-a446-4a035c951c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3', 'volume_name': 'volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3', 'volume_size': 1, 'snapshot_id': '3ab7912c-0f4b-47ab-9e05-b989a5522788'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d34df07-c4bd-44b9-95e0-18a69f58b3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d34df07-c4bd-44b9-95e0-18a69f58b3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac4cdbe-5f50-42e8-ab27-aab399c4a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Volume 82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3', 'volume_size': 1, 'snapshot_id': '3ab7912c-0f4b-47ab-9e05-b989a5522788'} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-quobyte-3ab7912c-0f4b-47ab-9e05-b989a5522788-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-3ab7912c-0f4b-47ab-9e05-b989a5522788-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Creating volume 82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 from snapshot 3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-quobyte-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] snapshot: 3ab7912c-0f4b-47ab-9e05-b989a5522788, volume: 82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e2c905-97fa-4d17-b389-420e52144553]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:00 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 Jul 10 19:54:00 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:01 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788" returned: 0 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-762b1e07-05ae-4943-9227-3d8924b6dcdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:54:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:54:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:54:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723677a-af9b-4abe-a213-b64b3b7f5919]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:01 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:54:01 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:02 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.808s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:02 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 Jul 10 19:54:02 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (f3b15c8f-af17-4c21-a8c4-19aae9dfde23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24444f1-01e1-416b-a2c4-0e874b7974f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24444f1-01e1-416b-a2c4-0e874b7974f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051700617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0caf102-40fe-455e-bf12-85e4d2099da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:03Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18298df-352e-4620-8448-de180c022562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18298df-352e-4620-8448-de180c022562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faf20db-d229-4da7-9a33-87a8e03a13ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faf20db-d229-4da7-9a33-87a8e03a13ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0caf102-40fe-455e-bf12-85e4d2099da5', 'volume_name': 'volume-c0caf102-40fe-455e-bf12-85e4d2099da5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03da26b1-16e0-4a15-9221-59cab184beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03da26b1-16e0-4a15-9221-59cab184beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db075e-6ac8-4725-b9e0-eb0930c4fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:02 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Volume c0caf102-40fe-455e-bf12-85e4d2099da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0caf102-40fe-455e-bf12-85e4d2099da5', 'volume_size': 1} Jul 10 19:54:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (8c4d24a9-b070-40fb-b5ac-2cb37f7d54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb5ad6a-9b19-4cce-998d-7d5a02ea20ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb5ad6a-9b19-4cce-998d-7d5a02ea20ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-842072915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae7dcab-312b-4f0e-a712-ee18efdb7843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:03Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50afc7f0-94b2-41d2-b6f7-e3fca84b61dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50afc7f0-94b2-41d2-b6f7-e3fca84b61dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b91679e-6bfe-4fdd-b30b-406fd48022cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b91679e-6bfe-4fdd-b30b-406fd48022cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae7dcab-312b-4f0e-a712-ee18efdb7843', 'volume_name': 'volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cef911-7539-49ed-9f90-893216439b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cef911-7539-49ed-9f90-893216439b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab574fb4-0629-4138-b0af-99d6d20d493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:03 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Volume 4ae7dcab-312b-4f0e-a712-ee18efdb7843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843', 'volume_size': 1} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=100,cinder:UPDATE=96,cinder:INSERT=35,cinder:DELETE=7 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=81,cinder:UPDATE=109,cinder:DELETE=8,cinder:INSERT=35 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (bf833bdf-6f1e-4640-8271-cfd32f23a11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4c7662-cdf1-4e9a-9806-8dde38fdd60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4c7662-cdf1-4e9a-9806-8dde38fdd60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868598677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07c039d-3ab2-403c-971a-8d8a86dfb299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:04Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5133d70-4418-4370-971e-87a206d6dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5133d70-4418-4370-971e-87a206d6dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3eaeb3-3297-47b9-b52d-810ff4a4cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3eaeb3-3297-47b9-b52d-810ff4a4cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07c039d-3ab2-403c-971a-8d8a86dfb299', 'volume_name': 'volume-c07c039d-3ab2-403c-971a-8d8a86dfb299', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5553a5-473d-400f-b9a9-e8645e8d6ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5553a5-473d-400f-b9a9-e8645e8d6ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf5ac6c-7c65-45aa-bdc8-ce3e3c9ebd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Volume c07c039d-3ab2-403c-971a-8d8a86dfb299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07c039d-3ab2-403c-971a-8d8a86dfb299', 'volume_size': 1} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (c018ee49-636e-4239-9eb0-fc4020e8d0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf88565-1b31-4ce7-8c42-ba83aaa57086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf88565-1b31-4ce7-8c42-ba83aaa57086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296638453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b1d580-41c7-4752-847f-dc61c8213ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:05Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaed47d1-3206-45ad-8d46-00c0326857ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaed47d1-3206-45ad-8d46-00c0326857ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acdbfd5-aeec-4c04-8707-21a014c27a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acdbfd5-aeec-4c04-8707-21a014c27a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b1d580-41c7-4752-847f-dc61c8213ac8', 'volume_name': 'volume-94b1d580-41c7-4752-847f-dc61c8213ac8', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3c3658-14fc-45cf-a6de-6b70bf8ec7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3c3658-14fc-45cf-a6de-6b70bf8ec7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00161851-0f4d-40bd-b6e6-5fda3533628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Volume 94b1d580-41c7-4752-847f-dc61c8213ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b1d580-41c7-4752-847f-dc61c8213ac8', 'volume_size': 1} Jul 10 19:54:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (f31ce538-61ac-4ddc-831a-df52bba96b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c357b25-6771-4088-acf8-5be4194b3385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c357b25-6771-4088-acf8-5be4194b3385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1360512947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:05Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200f0bbb-2eb9-4164-a160-028b1852c59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200f0bbb-2eb9-4164-a160-028b1852c59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150e90cc-759d-4ce2-8a28-94770ae3aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150e90cc-759d-4ce2-8a28-94770ae3aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab', 'volume_name': 'volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d4b7b9-6eb6-4b9c-996f-70cc4fba65d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d4b7b9-6eb6-4b9c-996f-70cc4fba65d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714e53c3-82e2-49fc-90d1-b5809e96c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Volume 5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab', 'volume_size': 1} Jul 10 19:54:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:07 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" returned: 0 in 5.235s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:07 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08bff2e-d8e5-422b-a137-ab4f74990f1e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:07 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:54:07 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:08 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:08 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:54:08 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Converted 1024.00 MB image at 195.56 MB/s Jul 10 19:54:08 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 is being set with open permissions: ugo+rw Jul 10 19:54:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:08 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 Jul 10 19:54:08 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:09 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" returned: 0 in 0.640s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" released by "_copy_volume_from_snapshot" :: held 8.564s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-3ab7912c-0f4b-47ab-9e05-b989a5522788-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" released by "_create_volume_from_snapshot" :: held 8.596s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.615s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.362s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051700617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0caf102-40fe-455e-bf12-85e4d2099da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:03Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Creating volume c0caf102-40fe-455e-bf12-85e4d2099da5 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:09 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:09 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 1073741824 Jul 10 19:54:09 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac4cdbe-5f50-42e8-ab27-aab399c4a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3', 'volume_size': 1, 'snapshot_id': '3ab7912c-0f4b-47ab-9e05-b989a5522788'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b760a928-d86a-435c-9dfc-ad0b4d59731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:09 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Volume volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 (82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3): created successfully Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b760a928-d86a-435c-9dfc-ad0b4d59731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Flow 'volume_create_manager' (9ea31092-43b1-4179-a683-84cbc56f35df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a8ce835a-4238-495d-ad46-f61aeba640ee tempest-VolumeDependencyTests-1808544073 None] Created volume successfully. Jul 10 19:54:09 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 1073741824" returned: 0 in 0.812s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:10 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 Jul 10 19:54:10 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-3ab7912c-0f4b-47ab-9e05-b989a5522788-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-3ab7912c-0f4b-47ab-9e05-b989a5522788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-quobyte-762b1e07-05ae-4943-9227-3d8924b6dcdf" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-762b1e07-05ae-4943-9227-3d8924b6dcdf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-quobyte-3ab7912c-0f4b-47ab-9e05-b989a5522788" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-3ab7912c-0f4b-47ab-9e05-b989a5522788" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Deleting offline snapshot 3ab7912c-0f4b-47ab-9e05-b989a5522788 of volume 762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] snapshot_file for this snap is: volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f100fd-819c-4d02-86d8-d3a1e60028b5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:10 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 Jul 10 19:54:10 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:10 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5" returned: 0 in 0.682s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.558s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-842072915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae7dcab-312b-4f0e-a712-ee18efdb7843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:03Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Creating volume 4ae7dcab-312b-4f0e-a712-ee18efdb7843 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:10 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:10 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 1073741824 Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db075e-6ac8-4725-b9e0-eb0930c4fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0caf102-40fe-455e-bf12-85e4d2099da5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:10 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62750071-7dcb-4bd5-a3e3-ed6962164d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:10 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Volume volume-c0caf102-40fe-455e-bf12-85e4d2099da5 (c0caf102-40fe-455e-bf12-85e4d2099da5): created successfully Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62750071-7dcb-4bd5-a3e3-ed6962164d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (f3b15c8f-af17-4c21-a8c4-19aae9dfde23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9071ec13-d129-4c7e-ad81-ee8dc4b62cd3 tempest-CreateVolumesFromImageTest-1468799588 None] Created volume successfully. Jul 10 19:54:11 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788" returned: 0 in 0.796s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-762b1e07-05ae-4943-9227-3d8924b6dcdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:54:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c752e2-989a-4e64-b517-15aee0af0590]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:11 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:54:11 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:11 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 1073741824" returned: 0 in 0.861s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:11 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 Jul 10 19:54:11 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:12 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:12 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 Jul 10 19:54:12 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:12 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843" returned: 0 in 0.693s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.137s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868598677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07c039d-3ab2-403c-971a-8d8a86dfb299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:04Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Creating volume c07c039d-3ab2-403c-971a-8d8a86dfb299 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:12 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab574fb4-0629-4138-b0af-99d6d20d493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:12 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 1073741824 Jul 10 19:54:12 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056119a4-8076-4722-82b0-7988deb1e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:12 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Volume volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 (4ae7dcab-312b-4f0e-a712-ee18efdb7843): created successfully Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056119a4-8076-4722-82b0-7988deb1e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (8c4d24a9-b070-40fb-b5ac-2cb37f7d54db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-744c6a48-f6be-4940-83b0-e48e1c88e8f6 tempest-CreateVolumesFromImageTest-1468799588 None] Created volume successfully. Jul 10 19:54:12 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788" returned: 0 in 0.740s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:12 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788 Jul 10 19:54:12 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:13 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 1073741824" returned: 0 in 0.896s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:13 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 Jul 10 19:54:13 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:13 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf.3ab7912c-0f4b-47ab-9e05-b989a5522788" returned: 0 in 0.710s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-3ab7912c-0f4b-47ab-9e05-b989a5522788" released by "_delete_snapshot" :: held 3.149s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-762b1e07-05ae-4943-9227-3d8924b6dcdf" released by "delete_snapshot" :: held 3.171s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Created reservations ['95cac395-c8ec-401b-b437-c96c96eb4cab', 'c9c6ef6e-a5ca-404d-81c6-e7a3a6ca9991', '22260be0-da4b-4501-a267-33db6115710b', '23d646ad-88ad-40d1-9130-b5c7937e9a9e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:13 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Delete snapshot completed successfully. Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc95a49e-68cf-494f-a070-240bfb565dc1 tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-3ab7912c-0f4b-47ab-9e05-b989a5522788-delete_snapshot" released by "delete_snapshot" :: held 3.316s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:13 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299" returned: 0 in 0.641s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.939s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296638453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b1d580-41c7-4752-847f-dc61c8213ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:05Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Creating volume 94b1d580-41c7-4752-847f-dc61c8213ac8 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:13 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:13 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 1073741824 Jul 10 19:54:13 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf5ac6c-7c65-45aa-bdc8-ce3e3c9ebd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07c039d-3ab2-403c-971a-8d8a86dfb299', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8420d803-755b-4ee9-b93c-324130626299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:13 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Volume volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 (c07c039d-3ab2-403c-971a-8d8a86dfb299): created successfully Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8420d803-755b-4ee9-b93c-324130626299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (bf833bdf-6f1e-4640-8271-cfd32f23a11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:13 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-75db345b-0b2c-4a7b-9a13-0862129c5fea tempest-CreateVolumesFromImageTest-1468799588 None] Created volume successfully. Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-762b1e07-05ae-4943-9227-3d8924b6dcdf-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-762b1e07-05ae-4943-9227-3d8924b6dcdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-quobyte-762b1e07-05ae-4943-9227-3d8924b6dcdf" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-762b1e07-05ae-4943-9227-3d8924b6dcdf" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[722e3720-ff47-4c09-b37e-c8976e6691d5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:14 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 1073741824" returned: 0 in 0.891s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:14 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:54:14 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:14 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 Jul 10 19:54:14 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:15 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8" returned: 0 in 0.668s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.847s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1360512947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd20775d88ea456db184dc4280e9258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:05Z,use_quota=True,user_id='081546b17fb44176990bc21b4bd6a85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Creating volume 5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:15 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:15 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:15 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab 1073741824 Jul 10 19:54:15 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00161851-0f4d-40bd-b6e6-5fda3533628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b1d580-41c7-4752-847f-dc61c8213ac8', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a262eea8-3879-4a03-9906-5d878127d025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:15 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf Jul 10 19:54:15 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Volume volume-94b1d580-41c7-4752-847f-dc61c8213ac8 (94b1d580-41c7-4752-847f-dc61c8213ac8): created successfully Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a262eea8-3879-4a03-9906-5d878127d025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (c018ee49-636e-4239-9eb0-fc4020e8d0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-18f01679-fb2d-4cb2-93c5-6d0f9eff91db tempest-CreateVolumesFromImageTest-1468799588 None] Created volume successfully. Jul 10 19:54:16 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-762b1e07-05ae-4943-9227-3d8924b6dcdf" returned: 0 in 0.691s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-762b1e07-05ae-4943-9227-3d8924b6dcdf" released by "delete_volume" :: held 1.601s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Created reservations ['59365593-1b4c-4018-bd18-1ee1f072ce49', 'c1bf5e34-0a1e-457d-afd1-5d7693cc7be6', '3c4d8533-c007-4a8f-96be-f972239d160f', 'a2b5d33c-01f8-48cc-85df-d4eb2cc65b30'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:16 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:16 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:16 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab 1073741824" returned: 0 in 0.916s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:16 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab Jul 10 19:54:16 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "cinder-quobyte-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef77221-bfbd-4564-9868-192ee965c160]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:17 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 Jul 10 19:54:17 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:17 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.701s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Deleted volume successfully. Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c80cdecd-31c2-47a0-ab00-2c73890325dd tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-762b1e07-05ae-4943-9227-3d8924b6dcdf-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:17 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab" returned: 0 in 0.743s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714e53c3-82e2-49fc-90d1-b5809e96c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea5f70e-68f8-4443-bba0-bf573e31b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:17 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Volume volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab (5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab): created successfully Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea5f70e-68f8-4443-bba0-bf573e31b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Flow 'volume_create_manager' (f31ce538-61ac-4ddc-831a-df52bba96b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5da77e58-2c03-482e-a673-35aac34bc62a tempest-CreateVolumesFromImageTest-1468799588 None] Created volume successfully. Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-quobyte-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3846fe-066d-46af-b989-9761f1c5224a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:17 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab Jul 10 19:54:17 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:17 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" returned: 0 in 0.848s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:17 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3 Jul 10 19:54:17 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:18 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab" returned: 0 in 0.794s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:18 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab Jul 10 19:54:18 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:18 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-quobyte-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3" released by "delete_volume" :: held 1.557s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Created reservations ['6cc91f43-70a7-4025-a1c5-4407c58dae92', 'df9cbd68-9b86-49ca-bb77-9a859e4ff254', 'dc8b3095-820a-48cd-8a78-4db6014b537b', '4b1513e7-4ca4-4231-81b1-67e76d45147b'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:18 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:18 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:18 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab" returned: 0 in 0.678s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab" released by "delete_volume" :: held 1.530s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Created reservations ['ab384b62-9665-4dc4-9ce1-4f2603f95fcc', 'b796914b-ef5c-4cc7-8baf-5c17901a6708', '47d0ee13-65d9-4aaf-a71c-d5d9240d0e5c', 'e6dea86e-ff89-4070-93d3-7bde7b273e5b'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:19 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:19 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:19 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.701s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:19 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Deleted volume successfully. Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-faceaf7d-88a5-4f6d-92cd-b2fe6b09707d tempest-VolumeDependencyTests-1808544073 None] Lock "cinder-82d82f5f-031d-4bd2-9a07-9ee5b7a50dc3-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-94b1d580-41c7-4752-847f-dc61c8213ac8-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-94b1d580-41c7-4752-847f-dc61c8213ac8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-quobyte-94b1d580-41c7-4752-847f-dc61c8213ac8" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-94b1d580-41c7-4752-847f-dc61c8213ac8" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0feb5c4-e4c9-4f1b-b5ff-e78ccec5ff18]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:19 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 Jul 10 19:54:19 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:19 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.755s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:19 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Deleted volume successfully. Jul 10 19:54:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18ce7db6-e6ef-4ea9-b108-4cb150e7172e tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-5ffff676-dfbb-4059-bd5c-f5ccfba0e0ab-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:20 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8" returned: 0 in 0.862s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:20 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8 Jul 10 19:54:20 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:21 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-94b1d580-41c7-4752-847f-dc61c8213ac8" returned: 0 in 0.674s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-94b1d580-41c7-4752-847f-dc61c8213ac8" released by "delete_volume" :: held 1.586s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Created reservations ['134a515e-a617-4702-86e3-3194052455a0', '4de1a4a6-08b1-4a27-9fbc-0cf93fad5221', '61d7cca0-8171-4df7-97e7-1db279bdfaf7', '2b8fb014-44d0-4a5b-8b0e-72fa792a3a7e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:21 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:21 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-c07c039d-3ab2-403c-971a-8d8a86dfb299-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-c07c039d-3ab2-403c-971a-8d8a86dfb299-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-quobyte-c07c039d-3ab2-403c-971a-8d8a86dfb299" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-c07c039d-3ab2-403c-971a-8d8a86dfb299" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[23618c98-a568-4094-8dff-9ae00d5580f7]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:22 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 Jul 10 19:54:22 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:22 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.732s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Deleted volume successfully. Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-4c8e0fbd-391b-42e1-bec2-891c36332e83 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-94b1d580-41c7-4752-847f-dc61c8213ac8-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:22 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299" returned: 0 in 0.866s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:22 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299 Jul 10 19:54:22 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Flow 'volume_create_manager' (d5d4395b-6179-49e0-8538-e5da8f5f3748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4a662c-9baf-4b2c-9164-6ad621d119fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4a662c-9baf-4b2c-9164-6ad621d119fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364504435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a72945b-dfee-44f9-afb3-df9a87edfc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3e5b15e87647ec9eb08ebf3f02aa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:23Z,use_quota=True,user_id='50b83d4e9d974cbfa9a7b8c52f8a3a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c86934-a3dd-4bab-8667-3440da88467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c86934-a3dd-4bab-8667-3440da88467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9800d465-a88d-4a29-a52f-89cff23f05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9800d465-a88d-4a29-a52f-89cff23f05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a72945b-dfee-44f9-afb3-df9a87edfc84', 'volume_name': 'volume-6a72945b-dfee-44f9-afb3-df9a87edfc84', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2771f25-31cc-4c5e-a570-0059759a7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2771f25-31cc-4c5e-a570-0059759a7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f947b62b-d79e-40a2-8972-c63ea3142667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Volume 6a72945b-dfee-44f9-afb3-df9a87edfc84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a72945b-dfee-44f9-afb3-df9a87edfc84', 'volume_size': 1} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364504435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a72945b-dfee-44f9-afb3-df9a87edfc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3e5b15e87647ec9eb08ebf3f02aa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:23Z,use_quota=True,user_id='50b83d4e9d974cbfa9a7b8c52f8a3a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Creating volume 6a72945b-dfee-44f9-afb3-df9a87edfc84 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:23 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:23 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 1073741824 Jul 10 19:54:23 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:23 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c07c039d-3ab2-403c-971a-8d8a86dfb299" returned: 0 in 0.680s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-c07c039d-3ab2-403c-971a-8d8a86dfb299" released by "delete_volume" :: held 1.592s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Created reservations ['7c79b980-0811-45f4-9313-537252c016e2', 'ebdc6a28-0d0f-42f1-9308-92b1b9230617', '5698a3bc-c541-4e7b-9e69-a7c9ad58bef4', '7231f57c-c990-4328-8714-281aa2215eab'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:23 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:23 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:23 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 1073741824" returned: 0 in 0.849s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:23 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 Jul 10 19:54:23 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-4ae7dcab-312b-4f0e-a712-ee18efdb7843-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-4ae7dcab-312b-4f0e-a712-ee18efdb7843-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-quobyte-4ae7dcab-312b-4f0e-a712-ee18efdb7843" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-4ae7dcab-312b-4f0e-a712-ee18efdb7843" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[471c07cb-88f1-485e-822d-6c24cb76cd0d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:24 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 Jul 10 19:54:24 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:24 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Deleted volume successfully. Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-61410b7e-320c-4638-b1f8-072c5a8e0045 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-c07c039d-3ab2-403c-971a-8d8a86dfb299-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:24 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84" returned: 0 in 0.648s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f947b62b-d79e-40a2-8972-c63ea3142667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a72945b-dfee-44f9-afb3-df9a87edfc84', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c673cbe9-bf8d-49a9-b74a-abc5eb8adbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Volume volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 (6a72945b-dfee-44f9-afb3-df9a87edfc84): created successfully Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c673cbe9-bf8d-49a9-b74a-abc5eb8adbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Flow 'volume_create_manager' (d5d4395b-6179-49e0-8538-e5da8f5f3748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3986baaa-6330-4bce-bee6-e9d514c1d14f tempest-ProjectReaderTests-2070227733 None] Created volume successfully. Jul 10 19:54:25 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843" returned: 0 in 0.800s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:25 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843 Jul 10 19:54:25 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Acquiring lock "cinder-6a72945b-dfee-44f9-afb3-df9a87edfc84-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Lock "cinder-6a72945b-dfee-44f9-afb3-df9a87edfc84-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Acquiring lock "cinder-quobyte-6a72945b-dfee-44f9-afb3-df9a87edfc84" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Lock "cinder-quobyte-6a72945b-dfee-44f9-afb3-df9a87edfc84" acquired by "delete_volume" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9e9cbe-0e5f-4e02-8afa-ad5d8d44f008]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:25 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 Jul 10 19:54:25 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:25 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4ae7dcab-312b-4f0e-a712-ee18efdb7843" returned: 0 in 0.670s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-4ae7dcab-312b-4f0e-a712-ee18efdb7843" released by "delete_volume" :: held 1.515s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Created reservations ['9e32dcbf-6666-4bb0-93c8-04f4cd28e797', 'dfe717fd-dd8e-4163-b088-150c88594c02', '9fd10f75-c3d5-482f-b8f5-420cda7c4b57', '2f8401df-84e3-4d09-8f80-d88eec4bfff9'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:25 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:25 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:26 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84" returned: 0 in 0.800s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:26 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84 Jul 10 19:54:26 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-c0caf102-40fe-455e-bf12-85e4d2099da5-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-c0caf102-40fe-455e-bf12-85e4d2099da5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "cinder-quobyte-c0caf102-40fe-455e-bf12-85e4d2099da5" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-c0caf102-40fe-455e-bf12-85e4d2099da5" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[484adb57-47c3-4c6e-a40b-ea449c2a1177]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:26 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.716s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Deleted volume successfully. Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-218ad846-8c8d-4039-8748-6bc12851330f tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-4ae7dcab-312b-4f0e-a712-ee18efdb7843-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:26 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 Jul 10 19:54:26 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:26 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6a72945b-dfee-44f9-afb3-df9a87edfc84" returned: 0 in 0.679s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Lock "cinder-quobyte-6a72945b-dfee-44f9-afb3-df9a87edfc84" released by "delete_volume" :: held 1.521s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Created reservations ['adf30cb4-33de-4daf-96b0-c9acacf65e93', '3a60695e-c7ef-4a3e-845d-9c3ceae5b745', 'accecb5c-77d9-44b3-b554-1893c5518f0b', 'cb31d8e7-d7d5-4f08-89e2-96264b1912f8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:26 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:26 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:27 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:27 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5 Jul 10 19:54:27 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:27 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.686s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Deleted volume successfully. Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e9116c89-96ad-431a-8be9-afdf23a536de tempest-ProjectReaderTests-2070227733 None] Lock "cinder-6a72945b-dfee-44f9-afb3-df9a87edfc84-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Flow 'volume_create_manager' (ae862a7b-0a1e-4900-b52b-3ac8cb2ef3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f859c68f-1f08-4153-a0e5-1298491872e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f859c68f-1f08-4153-a0e5-1298491872e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079536343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c50e63-dc66-47af-b43d-de1c31de1921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3e5b15e87647ec9eb08ebf3f02aa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:28Z,use_quota=True,user_id='50b83d4e9d974cbfa9a7b8c52f8a3a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1285d5-d534-4ad9-8309-c1f9d06900a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1285d5-d534-4ad9-8309-c1f9d06900a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cdc2a6-4d77-48b5-950f-72255a3c4feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cdc2a6-4d77-48b5-950f-72255a3c4feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c50e63-dc66-47af-b43d-de1c31de1921', 'volume_name': 'volume-74c50e63-dc66-47af-b43d-de1c31de1921', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e058699-f660-4479-9819-1ecfc82faaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e058699-f660-4479-9819-1ecfc82faaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40d84a5-8f82-4cbb-92f8-d75c0d0bd6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Volume 74c50e63-dc66-47af-b43d-de1c31de1921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c50e63-dc66-47af-b43d-de1c31de1921', 'volume_size': 1} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079536343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c50e63-dc66-47af-b43d-de1c31de1921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3e5b15e87647ec9eb08ebf3f02aa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:28Z,use_quota=True,user_id='50b83d4e9d974cbfa9a7b8c52f8a3a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Creating volume 74c50e63-dc66-47af-b43d-de1c31de1921 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:27 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:28 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:28 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 1073741824 Jul 10 19:54:28 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c0caf102-40fe-455e-bf12-85e4d2099da5" returned: 0 in 0.667s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-quobyte-c0caf102-40fe-455e-bf12-85e4d2099da5" released by "delete_volume" :: held 1.522s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Created reservations ['03d016d7-a3fc-4182-83fc-2377e55da15b', '8df42cb0-5565-49c0-971f-f773b70bd3dd', '814e0264-765c-42d8-bb0c-a86ba6e02e6e', 'c1b7d48f-4af8-4efd-9d6b-db5a98f0b7b6'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:28 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:28 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:28 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.703s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Deleted volume successfully. Jul 10 19:54:28 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 1073741824" returned: 0 in 0.893s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f3f8fbfc-46f0-4aa2-bf1e-d7f964c2b590 tempest-CreateVolumesFromImageTest-1468799588 None] Lock "cinder-c0caf102-40fe-455e-bf12-85e4d2099da5-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:28 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 Jul 10 19:54:28 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:29 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40d84a5-8f82-4cbb-92f8-d75c0d0bd6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c50e63-dc66-47af-b43d-de1c31de1921', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758bb170-a197-44d9-a99d-13a8040f4133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Volume volume-74c50e63-dc66-47af-b43d-de1c31de1921 (74c50e63-dc66-47af-b43d-de1c31de1921): created successfully Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758bb170-a197-44d9-a99d-13a8040f4133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Flow 'volume_create_manager' (ae862a7b-0a1e-4900-b52b-3ac8cb2ef3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1254d9a7-9d10-4d13-99ce-c3fd865ca974 tempest-ProjectReaderTests-2070227733 None] Created volume successfully. Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Acquiring lock "cinder-74c50e63-dc66-47af-b43d-de1c31de1921-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Lock "cinder-74c50e63-dc66-47af-b43d-de1c31de1921-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Acquiring lock "cinder-quobyte-74c50e63-dc66-47af-b43d-de1c31de1921" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Lock "cinder-quobyte-74c50e63-dc66-47af-b43d-de1c31de1921" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe12969c-59fe-4ad7-94d0-e0a319fea820]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:30 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 Jul 10 19:54:30 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:30 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921" returned: 0 in 0.789s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:30 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921 Jul 10 19:54:30 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:31 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-74c50e63-dc66-47af-b43d-de1c31de1921" returned: 0 in 0.705s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Lock "cinder-quobyte-74c50e63-dc66-47af-b43d-de1c31de1921" released by "delete_volume" :: held 1.544s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (aa2a8739-b63e-4a1a-8d65-1c2be88921e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d488196-8af0-4a5c-b579-2e085c9b6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d488196-8af0-4a5c-b579-2e085c9b6014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953460628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1856fae-326d-45bf-8137-73ceff5b43ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:32Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7ddbb1-64a1-48f7-a23e-077ddc5c3b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7ddbb1-64a1-48f7-a23e-077ddc5c3b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c614ac7-ce36-4bd1-8c18-cef207d550a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c614ac7-ce36-4bd1-8c18-cef207d550a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1856fae-326d-45bf-8137-73ceff5b43ef', 'volume_name': 'volume-b1856fae-326d-45bf-8137-73ceff5b43ef', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730a2b76-f2d9-4936-9056-0f45dc02a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730a2b76-f2d9-4936-9056-0f45dc02a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a80830a-2e04-419e-9c90-349da55e33d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:31 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume b1856fae-326d-45bf-8137-73ceff5b43ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1856fae-326d-45bf-8137-73ceff5b43ef', 'volume_size': 1} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953460628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1856fae-326d-45bf-8137-73ceff5b43ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:32Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating volume b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:31 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Created reservations ['d73994ab-7035-4508-bd42-bd4e61ddf60d', '899b212a-4158-4682-a7c9-9c71a332712f', '1eac805d-1398-429f-9a60-711a2ad31066', '38162ea3-2839-49e8-b0db-8287df64bf66'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:31 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef 1073741824 Jul 10 19:54:31 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:31 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:31 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:32 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.709s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:32 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Deleted volume successfully. Jul 10 19:54:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f73ef110-6262-41f3-88e6-732378127d17 tempest-ProjectReaderTests-2070227733 None] Lock "cinder-74c50e63-dc66-47af-b43d-de1c31de1921-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:32 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef 1073741824" returned: 0 in 0.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:32 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef Jul 10 19:54:32 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:33 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef" returned: 0 in 0.662s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a80830a-2e04-419e-9c90-349da55e33d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1856fae-326d-45bf-8137-73ceff5b43ef', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3b6a98-6c58-4d96-aca4-a362ba5559e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:33 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume volume-b1856fae-326d-45bf-8137-73ceff5b43ef (b1856fae-326d-45bf-8137-73ceff5b43ef): created successfully Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3b6a98-6c58-4d96-aca4-a362ba5559e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (aa2a8739-b63e-4a1a-8d65-1c2be88921e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:33 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9cd2913f-2d2c-4e29-8bc1-ef280ed409da tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created volume successfully. Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating offline snapshot df5b7774-864b-45c7-8254-604c8c2e9511 of volume b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:54:34 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1087943b-b47b-4764-b2cf-d146e54cde95]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:34 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef Jul 10 19:54:34 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:34 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef" returned: 0 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:34 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 1G Jul 10 19:54:34 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:35 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 1G" returned: 0 in 0.862s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1856fae-326d-45bf-8137-73ceff5b43ef -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:35 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1856fae-326d-45bf-8137-73ceff5b43ef -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 Jul 10 19:54:35 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:36 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1856fae-326d-45bf-8137-73ceff5b43ef -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:36 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 is being set with open permissions: ugo+rw Jul 10 19:54:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:36 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 Jul 10 19:54:36 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:37 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511" returned: 0 in 0.670s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:37 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info Jul 10 19:54:37 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:37 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:37 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:37 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:37 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info is being set with open permissions: ugo+rw Jul 10 19:54:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:37 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info Jul 10 19:54:37 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:38 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.783s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:54:38 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.info" returned: 0 in 0.716s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.624s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-937517a8-478d-4307-b2a0-2240f5ea78ab tempest-CreateVolumesFromSnapshotTest-2008516478 None] Create snapshot completed successfully Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (f58c5267-6bc9-4d0b-93dc-8abf71ca3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b8a276-cdf0-4192-973a-7e7e49e0cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b8a276-cdf0-4192-973a-7e7e49e0cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708541481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dd0f36-6e20-415e-aa8e-4b3113efe63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:40Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca5983e-e866-4527-bf7c-f4e7baa1d46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca5983e-e866-4527-bf7c-f4e7baa1d46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22268862-4228-4bb0-ac6e-57bb6fef2b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22268862-4228-4bb0-ac6e-57bb6fef2b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4dd0f36-6e20-415e-aa8e-4b3113efe63c', 'volume_name': 'volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69282332-0ba6-4042-8832-0fb75c75ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69282332-0ba6-4042-8832-0fb75c75ae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ece425-7755-4c1c-b70b-92c2014ebc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume e4dd0f36-6e20-415e-aa8e-4b3113efe63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c', 'volume_size': 1} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708541481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dd0f36-6e20-415e-aa8e-4b3113efe63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:40Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating volume e4dd0f36-6e20-415e-aa8e-4b3113efe63c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:39 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:39 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c 1073741824 Jul 10 19:54:39 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (1e541f21-d2bf-4c53-93e6-cab295f911c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72804160-c412-403e-a5a3-8371d4d22091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72804160-c412-403e-a5a3-8371d4d22091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689058545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e221555-1559-457e-9b98-93e0f613e173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:40Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68a8de1-7633-4968-b91c-c35cfbd3b70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68a8de1-7633-4968-b91c-c35cfbd3b70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e71ab5-a9b1-48d6-a22c-45be85cbb1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e71ab5-a9b1-48d6-a22c-45be85cbb1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e221555-1559-457e-9b98-93e0f613e173', 'volume_name': 'volume-7e221555-1559-457e-9b98-93e0f613e173', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c2902c-f487-4f0d-bf7f-b77beec19293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c2902c-f487-4f0d-bf7f-b77beec19293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47658c08-1152-46c3-ba14-7dbd3d0b1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume 7e221555-1559-457e-9b98-93e0f613e173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e221555-1559-457e-9b98-93e0f613e173', 'volume_size': 1} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (360ab0ab-76d3-4510-8395-aff938ef26c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc482d5-6edd-42ef-82b1-e31f1d623254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc482d5-6edd-42ef-82b1-e31f1d623254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651996520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f523da1-254f-45b1-aafb-243a71176de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf236d82-3674-4bc5-b704-3568f978f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf236d82-3674-4bc5-b704-3568f978f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a81a20-ec05-47bf-afde-5367fb9504c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a81a20-ec05-47bf-afde-5367fb9504c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f523da1-254f-45b1-aafb-243a71176de1', 'volume_name': 'volume-7f523da1-254f-45b1-aafb-243a71176de1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a895f-e65c-44ee-ab5e-a6eaf9c57db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a895f-e65c-44ee-ab5e-a6eaf9c57db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689e69f2-dc62-44fc-8f08-0e485c8faed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:40 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume 7f523da1-254f-45b1-aafb-243a71176de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f523da1-254f-45b1-aafb-243a71176de1', 'volume_size': 1} Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:40 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c 1073741824" returned: 0 in 1.184s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:41 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c Jul 10 19:54:41 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (1692b114-bd2d-465e-bdaf-e9b4d320eeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1186363-55d0-45b0-8d50-c592b8857ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1186363-55d0-45b0-8d50-c592b8857ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687295791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12710ba-10b6-456b-83cd-3a1e4e4d4139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6decab91-5ee9-4e4f-b2c0-2432c4b343b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6decab91-5ee9-4e4f-b2c0-2432c4b343b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bd5b0a-07bd-462d-902d-a62f75a17785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bd5b0a-07bd-462d-902d-a62f75a17785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12710ba-10b6-456b-83cd-3a1e4e4d4139', 'volume_name': 'volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24953868-7e01-45c3-9f11-6985ef3a32de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24953868-7e01-45c3-9f11-6985ef3a32de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368bc0f0-acc0-4c60-908b-7fcefb676dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume f12710ba-10b6-456b-83cd-3a1e4e4d4139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139', 'volume_size': 1} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (7623ba25-600a-4af5-b0b9-e76ab2c6f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8ec3b3-03ca-42b2-b0f0-e2ee7ef65517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8ec3b3-03ca-42b2-b0f0-e2ee7ef65517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564755050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4be75d-bd66-439d-ac60-3c10a02a88ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176fdd69-88e6-49ed-b540-a52f3260a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176fdd69-88e6-49ed-b540-a52f3260a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9497aaad-ac26-43f2-a3c2-fbc2e4db0655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9497aaad-ac26-43f2-a3c2-fbc2e4db0655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4be75d-bd66-439d-ac60-3c10a02a88ce', 'volume_name': 'volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cbedc0-de4d-41f2-83ac-8b372f927cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cbedc0-de4d-41f2-83ac-8b372f927cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2992e94f-ad76-454c-b24d-081c4acd11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Volume bb4be75d-bd66-439d-ac60-3c10a02a88ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce', 'volume_size': 1} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (958de688-245f-41e6-b80a-ea976bd9250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e45537-9b58-4b3d-95d1-79ce327c959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e45537-9b58-4b3d-95d1-79ce327c959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-252890882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db7c195-fd01-4a4d-b473-56711549236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9b9159-e147-4354-b48a-83439354bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9b9159-e147-4354-b48a-83439354bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff5041d-c606-4b6d-9c2c-e86b2b56baa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff5041d-c606-4b6d-9c2c-e86b2b56baa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db7c195-fd01-4a4d-b473-56711549236d', 'volume_name': 'volume-0db7c195-fd01-4a4d-b473-56711549236d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f419af8a-4bf4-4172-9cb9-8eef106d3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f419af8a-4bf4-4172-9cb9-8eef106d3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361ced18-d8db-4b83-9888-0d208033b631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume 0db7c195-fd01-4a4d-b473-56711549236d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db7c195-fd01-4a4d-b473-56711549236d', 'volume_size': 1} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:41 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c" returned: 0 in 0.747s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689058545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e221555-1559-457e-9b98-93e0f613e173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:40Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating volume 7e221555-1559-457e-9b98-93e0f613e173 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:41 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ece425-7755-4c1c-b70b-92c2014ebc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 1073741824 Jul 10 19:54:41 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53b0948-cfea-42bf-bdc4-806a1c65e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:41 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c (e4dd0f36-6e20-415e-aa8e-4b3113efe63c): created successfully Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53b0948-cfea-42bf-bdc4-806a1c65e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (f58c5267-6bc9-4d0b-93dc-8abf71ca3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:41 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7a8d18ab-8a65-490a-922a-1d2dc185c495 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created volume successfully. Jul 10 19:54:42 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 1073741824" returned: 0 in 0.894s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:42 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 Jul 10 19:54:42 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:43 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173" returned: 0 in 0.658s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.663s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651996520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f523da1-254f-45b1-aafb-243a71176de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating volume 7f523da1-254f-45b1-aafb-243a71176de1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:43 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47658c08-1152-46c3-ba14-7dbd3d0b1499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e221555-1559-457e-9b98-93e0f613e173', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:43 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 1073741824 Jul 10 19:54:43 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e9c624-d7db-4a26-9121-8f7c8ca79990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume volume-7e221555-1559-457e-9b98-93e0f613e173 (7e221555-1559-457e-9b98-93e0f613e173): created successfully Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e9c624-d7db-4a26-9121-8f7c8ca79990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (1e541f21-d2bf-4c53-93e6-cab295f911c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0491d3c3-065d-4c3a-a1f7-051567e6b6f9 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created volume successfully. Jul 10 19:54:44 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 1073741824" returned: 0 in 0.823s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:44 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 Jul 10 19:54:44 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:44 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1" returned: 0 in 0.649s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.671s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687295791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12710ba-10b6-456b-83cd-3a1e4e4d4139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating volume f12710ba-10b6-456b-83cd-3a1e4e4d4139 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:44 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:44 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 1073741824 Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689e69f2-dc62-44fc-8f08-0e485c8faed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f523da1-254f-45b1-aafb-243a71176de1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:44 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c4124a-9a71-4d3d-9112-9f44e3869060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:44 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume volume-7f523da1-254f-45b1-aafb-243a71176de1 (7f523da1-254f-45b1-aafb-243a71176de1): created successfully Jul 10 19:54:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c4124a-9a71-4d3d-9112-9f44e3869060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (360ab0ab-76d3-4510-8395-aff938ef26c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-95844835-4479-4325-a9c8-01f007b30de2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created volume successfully. Jul 10 19:54:45 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 1073741824" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:45 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 Jul 10 19:54:45 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:46 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139" returned: 0 in 0.639s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.070s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564755050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4be75d-bd66-439d-ac60-3c10a02a88ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Creating volume bb4be75d-bd66-439d-ac60-3c10a02a88ce {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:46 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368bc0f0-acc0-4c60-908b-7fcefb676dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:46 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce 1073741824 Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e45e262-041a-4169-81c8-5955c5974cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:46 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:46 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 (f12710ba-10b6-456b-83cd-3a1e4e4d4139): created successfully Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e45e262-041a-4169-81c8-5955c5974cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (1692b114-bd2d-465e-bdaf-e9b4d320eeab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-688a0f3a-cc9b-4df6-a911-00f7d6bd8340 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created volume successfully. Jul 10 19:54:47 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce 1073741824" returned: 0 in 0.816s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:47 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce Jul 10 19:54:47 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:47 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.456s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-252890882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db7c195-fd01-4a4d-b473-56711549236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fa900d33a64b09aa6ab051467a1196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:41Z,use_quota=True,user_id='73063e79df9a4288acde6e5ae0c01315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Creating volume 0db7c195-fd01-4a4d-b473-56711549236d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:47 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2992e94f-ad76-454c-b24d-081c4acd11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:47 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d 1073741824 Jul 10 19:54:47 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daa09f9-6503-436c-92ba-f472324dd493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Volume volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce (bb4be75d-bd66-439d-ac60-3c10a02a88ce): created successfully Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daa09f9-6503-436c-92ba-f472324dd493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (7623ba25-600a-4af5-b0b9-e76ab2c6f137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-618a9b73-f892-4322-b719-d7b472710b7e tempest-ProjectReaderTests-534094439 None] Created volume successfully. Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-bb4be75d-bd66-439d-ac60-3c10a02a88ce-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Lock "cinder-bb4be75d-bd66-439d-ac60-3c10a02a88ce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-quobyte-bb4be75d-bd66-439d-ac60-3c10a02a88ce" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-bb4be75d-bd66-439d-ac60-3c10a02a88ce" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e380b6e5-f4d4-4c51-9bb6-e4d90eeb7d83]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:48 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce Jul 10 19:54:48 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:48 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d 1073741824" returned: 0 in 0.853s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:48 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d Jul 10 19:54:48 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:49 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce" returned: 0 in 0.775s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:49 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce Jul 10 19:54:49 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:49 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361ced18-d8db-4b83-9888-0d208033b631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db7c195-fd01-4a4d-b473-56711549236d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c867d648-8d5e-473c-9b9a-e812f94d4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:49 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Volume volume-0db7c195-fd01-4a4d-b473-56711549236d (0db7c195-fd01-4a4d-b473-56711549236d): created successfully Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c867d648-8d5e-473c-9b9a-e812f94d4337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Flow 'volume_create_manager' (958de688-245f-41e6-b80a-ea976bd9250e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4764dbdd-a681-41b4-a365-2e4eece19ccd tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created volume successfully. Jul 10 19:54:50 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-bb4be75d-bd66-439d-ac60-3c10a02a88ce" returned: 0 in 0.664s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-bb4be75d-bd66-439d-ac60-3c10a02a88ce" released by "delete_volume" :: held 1.478s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-0db7c195-fd01-4a4d-b473-56711549236d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-0db7c195-fd01-4a4d-b473-56711549236d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Created reservations ['90e89f06-ded9-4f0c-ba88-57af6ea562fb', '91d8e5fc-b727-4449-b884-19da203f86c2', '9de4a532-18cd-4804-a500-33763739f76f', '10b63c88-fc5a-4c01-8886-0bf2b1786944'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-0db7c195-fd01-4a4d-b473-56711549236d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-0db7c195-fd01-4a4d-b473-56711549236d" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f54b1-684f-4017-94c3-268aba0f15ca]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:50 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:50 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:50 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d Jul 10 19:54:50 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:50 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.664s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Deleted volume successfully. Jul 10 19:54:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-def0e82f-0fea-414d-86c6-bdfe72755f13 tempest-ProjectReaderTests-534094439 None] Lock "cinder-bb4be75d-bd66-439d-ac60-3c10a02a88ce-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:51 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d" returned: 0 in 0.828s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:51 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d Jul 10 19:54:51 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (216630e0-b547-4b56-9385-a3dc30c12308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46f0543-0fd6-4e1b-a9ad-31dea2c0354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46f0543-0fd6-4e1b-a9ad-31dea2c0354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518175463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9f02b0-646e-4af5-b5c1-b67e49f82d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:51Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251a1b72-07c9-44c4-a678-12e65f9f64f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251a1b72-07c9-44c4-a678-12e65f9f64f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58019979-b34a-426d-aa8e-0628ecfdf084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58019979-b34a-426d-aa8e-0628ecfdf084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9f02b0-646e-4af5-b5c1-b67e49f82d38', 'volume_name': 'volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d958814c-bc1d-40c3-9dcd-6aa83a792e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d958814c-bc1d-40c3-9dcd-6aa83a792e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75255046-87a4-438e-8058-4aaa17c02d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:51 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Volume ff9f02b0-646e-4af5-b5c1-b67e49f82d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38', 'volume_size': 1} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518175463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9f02b0-646e-4af5-b5c1-b67e49f82d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:51Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Creating volume ff9f02b0-646e-4af5-b5c1-b67e49f82d38 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:51 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:51 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 1073741824 Jul 10 19:54:51 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:51 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0db7c195-fd01-4a4d-b473-56711549236d" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-0db7c195-fd01-4a4d-b473-56711549236d" released by "delete_volume" :: held 1.569s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['f2bf27d7-5995-4dac-a08e-c1ec23897032', '8d4e6428-a75b-43fe-9d3a-9dcf4edaa588', '84798abc-a10c-4954-a379-4f92f94f4afa', 'fc3e70d2-3261-4afd-99cb-6deb1a19a9d5'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:51 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:51 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:52 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 1073741824" returned: 0 in 0.846s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:52 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 Jul 10 19:54:52 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-f12710ba-10b6-456b-83cd-3a1e4e4d4139-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-f12710ba-10b6-456b-83cd-3a1e4e4d4139-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-f12710ba-10b6-456b-83cd-3a1e4e4d4139" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-f12710ba-10b6-456b-83cd-3a1e4e4d4139" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa7348c-a650-4879-a468-b1f67aa0c048]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:52 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 Jul 10 19:54:52 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:52 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.737s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleted volume successfully. Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-95764ec1-f17b-4fed-99b6-007b9d0dbfa6 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-0db7c195-fd01-4a4d-b473-56711549236d-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:52 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75255046-87a4-438e-8058-4aaa17c02d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09722fee-8ec2-43f7-9e3c-6f4a72436cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:53 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Volume volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 (ff9f02b0-646e-4af5-b5c1-b67e49f82d38): created successfully Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09722fee-8ec2-43f7-9e3c-6f4a72436cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (216630e0-b547-4b56-9385-a3dc30c12308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:53 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c4d19ff8-fd62-42d7-b57f-4e4997d803bb tempest-ProjectReaderTests-534094439 None] Created volume successfully. Jul 10 19:54:53 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139" returned: 0 in 0.822s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:53 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139 Jul 10 19:54:53 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-ff9f02b0-646e-4af5-b5c1-b67e49f82d38-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Lock "cinder-ff9f02b0-646e-4af5-b5c1-b67e49f82d38-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-quobyte-ff9f02b0-646e-4af5-b5c1-b67e49f82d38" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-ff9f02b0-646e-4af5-b5c1-b67e49f82d38" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[36699403-5880-4afa-bbe3-ff401317953e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:53 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 Jul 10 19:54:53 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:53 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f12710ba-10b6-456b-83cd-3a1e4e4d4139" returned: 0 in 0.693s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-f12710ba-10b6-456b-83cd-3a1e4e4d4139" released by "delete_volume" :: held 1.567s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['c568c836-9769-4aa8-960a-930d27f12d95', '255e7994-ef5c-4581-8d32-bf92eb7f9cd3', 'df2064b2-8014-40fa-84c1-ae1af83c2abb', '62846999-2061-4128-992f-5d69e7e13085'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:54 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:54 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:54 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38" returned: 0 in 0.792s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:54 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38 Jul 10 19:54:54 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-7f523da1-254f-45b1-aafb-243a71176de1-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-7f523da1-254f-45b1-aafb-243a71176de1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-7f523da1-254f-45b1-aafb-243a71176de1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-7f523da1-254f-45b1-aafb-243a71176de1" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[555219cf-05d6-4cfa-8395-ef6f57f0244e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:54 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleted volume successfully. Jul 10 19:54:54 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 Jul 10 19:54:54 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c293592-e3ca-437d-a0e9-a03f18663409 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-f12710ba-10b6-456b-83cd-3a1e4e4d4139-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:55 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ff9f02b0-646e-4af5-b5c1-b67e49f82d38" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-ff9f02b0-646e-4af5-b5c1-b67e49f82d38" released by "delete_volume" :: held 1.546s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Created reservations ['b1ace899-82aa-4000-82ba-bfbe19174346', '797b13e8-128f-4938-b4d1-80426e0c0811', '0b932e3f-46bc-4b8c-9e50-8247b998e645', 'a58d9d0a-78dc-41ef-8fc4-bb5ef1c63dec'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:55 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:55 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:55 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1" returned: 0 in 0.795s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:55 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1 Jul 10 19:54:55 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:55 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.710s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:55 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Deleted volume successfully. Jul 10 19:54:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a691c4b-9f1b-4f10-85a3-a8fd3ac5a11c tempest-ProjectReaderTests-534094439 None] Lock "cinder-ff9f02b0-646e-4af5-b5c1-b67e49f82d38-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (b73e78c5-d83e-44b1-97dd-71b22bfa5f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34efc0c3-93a6-4538-a574-0c2a984794e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34efc0c3-93a6-4538-a574-0c2a984794e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197166869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e69aa2-3741-4d81-a8da-171bb9cc36f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:56Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad15e7dc-66a7-4504-9b07-f5047c75199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad15e7dc-66a7-4504-9b07-f5047c75199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce46806-97dd-4c02-9c3f-21d402b155bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce46806-97dd-4c02-9c3f-21d402b155bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e69aa2-3741-4d81-a8da-171bb9cc36f0', 'volume_name': 'volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5cd37d-e589-44fa-8e4f-38abbc63ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5cd37d-e589-44fa-8e4f-38abbc63ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7010f91-7b92-4f30-bd5c-93874f311a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:56 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Volume d0e69aa2-3741-4d81-a8da-171bb9cc36f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0', 'volume_size': 1} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197166869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e69aa2-3741-4d81-a8da-171bb9cc36f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:54:56Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Creating volume d0e69aa2-3741-4d81-a8da-171bb9cc36f0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:54:56 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:56 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 1073741824 Jul 10 19:54:56 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:56 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7f523da1-254f-45b1-aafb-243a71176de1" returned: 0 in 0.720s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-7f523da1-254f-45b1-aafb-243a71176de1" released by "delete_volume" :: held 1.567s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['2e5e8c5d-6078-4562-bc8f-27808b720d87', 'cf6cf0f0-5205-4eb0-99b2-154acce9205b', '775a8a53-fce9-4255-b1ab-c1c2feb9f513', '02726c82-d683-4b1f-bb4f-761af14a2452'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:56 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:56 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-7e221555-1559-457e-9b98-93e0f613e173-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-7e221555-1559-457e-9b98-93e0f613e173-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-7e221555-1559-457e-9b98-93e0f613e173" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-7e221555-1559-457e-9b98-93e0f613e173" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbf6840-146a-4e89-8d75-58f7b0c00080]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:57 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.726s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleted volume successfully. Jul 10 19:54:57 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:57 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 1073741824" returned: 0 in 0.957s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:57 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bdd08cdb-ce83-42ff-971a-e21152f4363b tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-7f523da1-254f-45b1-aafb-243a71176de1-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:57 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 Jul 10 19:54:57 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:57 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173" returned: 0 in 0.791s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:57 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0" returned: 0 in 0.643s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:57 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173 Jul 10 19:54:57 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7010f91-7b92-4f30-bd5c-93874f311a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec52ff1-1b51-42e6-89b9-e631d9d3b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:54:57 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Volume volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 (d0e69aa2-3741-4d81-a8da-171bb9cc36f0): created successfully Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec52ff1-1b51-42e6-89b9-e631d9d3b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:54:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (b73e78c5-d83e-44b1-97dd-71b22bfa5f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:54:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-14068315-10c0-4162-9b25-728015982895 tempest-ProjectReaderTests-534094439 None] Created volume successfully. Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-d0e69aa2-3741-4d81-a8da-171bb9cc36f0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Lock "cinder-d0e69aa2-3741-4d81-a8da-171bb9cc36f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-quobyte-d0e69aa2-3741-4d81-a8da-171bb9cc36f0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-d0e69aa2-3741-4d81-a8da-171bb9cc36f0" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a10ee1-bf0e-400b-8b2c-5065632a1a45]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:58 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7e221555-1559-457e-9b98-93e0f613e173" returned: 0 in 0.667s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:58 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 Jul 10 19:54:58 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-7e221555-1559-457e-9b98-93e0f613e173" released by "delete_volume" :: held 1.510s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['c942fe3b-1f37-4fa2-b1f6-d78d4c436b18', '71ed69d0-8e49-49f9-a83a-f9cfadc9d629', 'b1800ce7-094e-42df-a8e5-dad761585001', 'a15ac85a-9698-4b6c-8ff4-2a8981b5a17f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:58 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:54:58 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-e4dd0f36-6e20-415e-aa8e-4b3113efe63c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:59 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0" returned: 0 in 0.785s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-e4dd0f36-6e20-415e-aa8e-4b3113efe63c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:59 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0 Jul 10 19:54:59 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-e4dd0f36-6e20-415e-aa8e-4b3113efe63c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-e4dd0f36-6e20-415e-aa8e-4b3113efe63c" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea845d66-1937-4b7c-a74c-8c48050beaaf]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:54:59 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.702s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:54:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleted volume successfully. Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-22c5d5bc-3365-4128-be2a-68ce404654e7 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-7e221555-1559-457e-9b98-93e0f613e173-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:59 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c Jul 10 19:54:59 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:54:59 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d0e69aa2-3741-4d81-a8da-171bb9cc36f0" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-d0e69aa2-3741-4d81-a8da-171bb9cc36f0" released by "delete_volume" :: held 1.537s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Created reservations ['a005f8cd-bb56-4f68-bc96-b6881ea0b572', 'd1590f77-3756-4fa7-a93e-6f4da8a290a3', '7f55a30f-15da-4777-acd1-1085c62e1cb3', 'ff0f2824-ecdd-48fc-949a-bcfa61f0860e'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:54:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:00 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:00 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:00 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c" returned: 0 in 0.781s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:00 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c Jul 10 19:55:00 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:00 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.711s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Deleted volume successfully. Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-707f9675-a09b-4945-a6fa-e04dbe4034a2 tempest-ProjectReaderTests-534094439 None] Lock "cinder-d0e69aa2-3741-4d81-a8da-171bb9cc36f0-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:00 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e4dd0f36-6e20-415e-aa8e-4b3113efe63c" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-e4dd0f36-6e20-415e-aa8e-4b3113efe63c" released by "delete_volume" :: held 1.542s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['be1a8e93-f1cd-4fb0-be8b-85ee9c9f3e1c', '094ab510-dc7c-47cb-8cd2-4aca46b1c3db', '40157e0b-dd83-46d2-86f0-ea1768fc8f3b', '91604ca5-9a8e-4671-8852-8ad7b7c82713'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:00 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:00 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (d7ce2d1e-ab69-4f57-ab43-9dadf9846715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab320ec-34a0-4e58-bb4a-d9ca34dc5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab320ec-34a0-4e58-bb4a-d9ca34dc5468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122582965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bfb5e0-2ad0-41f5-bd06-53d92c311db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:01Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc035f5-6afa-4c89-942b-cc19d3b7d5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc035f5-6afa-4c89-942b-cc19d3b7d5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e35a7b-2117-45c6-aaa6-7e331da221a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e35a7b-2117-45c6-aaa6-7e331da221a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03bfb5e0-2ad0-41f5-bd06-53d92c311db4', 'volume_name': 'volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1f23c4-1be3-45eb-a5e5-13f86e6093c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1f23c4-1be3-45eb-a5e5-13f86e6093c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b75394d-1040-4a85-bb54-526e0d3f10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:01 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Volume 03bfb5e0-2ad0-41f5-bd06-53d92c311db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4', 'volume_size': 1} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122582965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bfb5e0-2ad0-41f5-bd06-53d92c311db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c1d429c69b42bcac72e8d2951a29d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:01Z,use_quota=True,user_id='29bf79b0c1e14616a4510c128f3090b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Creating volume 03bfb5e0-2ad0-41f5-bd06-53d92c311db4 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:01 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:01 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 1073741824 Jul 10 19:55:01 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-df5b7774-864b-45c7-8254-604c8c2e9511-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-df5b7774-864b-45c7-8254-604c8c2e9511-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-b1856fae-326d-45bf-8137-73ceff5b43ef" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-b1856fae-326d-45bf-8137-73ceff5b43ef" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-df5b7774-864b-45c7-8254-604c8c2e9511" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-df5b7774-864b-45c7-8254-604c8c2e9511" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleting offline snapshot df5b7774-864b-45c7-8254-604c8c2e9511 of volume b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] snapshot_file for this snap is: volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01604ff-237d-4344-85f1-0601274e5f19]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:01 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 Jul 10 19:55:01 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:01 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.733s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleted volume successfully. Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d918a4f5-a229-4c74-a797-5865dd383590 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-e4dd0f36-6e20-415e-aa8e-4b3113efe63c-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:01 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 1073741824" returned: 0 in 0.929s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:02 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 Jul 10 19:55:02 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:02 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511" returned: 0 in 0.839s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1856fae-326d-45bf-8137-73ceff5b43ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ddf4d3-a48d-44c2-9ba3-5c670ca06659]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:02 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef Jul 10 19:55:02 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:02 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b75394d-1040-4a85-bb54-526e0d3f10d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2f22a2-bddb-4ae7-b5f6-6ad7b100ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:02 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Volume volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 (03bfb5e0-2ad0-41f5-bd06-53d92c311db4): created successfully Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2f22a2-bddb-4ae7-b5f6-6ad7b100ca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:02 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Flow 'volume_create_manager' (d7ce2d1e-ab69-4f57-ab43-9dadf9846715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6c236b3c-7b76-4ed4-8b8c-ab4f15cd0199 tempest-ProjectReaderTests-534094439 None] Created volume successfully. Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-03bfb5e0-2ad0-41f5-bd06-53d92c311db4-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Lock "cinder-03bfb5e0-2ad0-41f5-bd06-53d92c311db4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:03 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef" returned: 0 in 0.801s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:03 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 Jul 10 19:55:03 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Acquiring lock "cinder-quobyte-03bfb5e0-2ad0-41f5-bd06-53d92c311db4" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-03bfb5e0-2ad0-41f5-bd06-53d92c311db4" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0e1fb-f320-4f45-a4da-e3b2c67bb006]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:03 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 Jul 10 19:55:03 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:03 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511" returned: 0 in 0.769s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:03 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511 Jul 10 19:55:03 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:04 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:04 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4 Jul 10 19:55:04 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:04 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef.df5b7774-864b-45c7-8254-604c8c2e9511" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=131,cinder:UPDATE=181,cinder:DELETE=22,cinder:INSERT=46 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=126,cinder:UPDATE=209,cinder:INSERT=44,cinder:DELETE=14 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-df5b7774-864b-45c7-8254-604c8c2e9511" released by "_delete_snapshot" :: held 3.205s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-b1856fae-326d-45bf-8137-73ceff5b43ef" released by "delete_snapshot" :: held 3.234s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['def0994d-03cf-428a-a0cc-24e58a0efe33', 'a2fa4e9b-44a1-4057-90e7-426750ed1df9', 'd84369cc-60b4-494f-bc0f-6b77dfbc1d4f', '8c0b4ff0-d979-4ba2-95e1-01762222efae'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:04 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-03bfb5e0-2ad0-41f5-bd06-53d92c311db4" returned: 0 in 0.688s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Lock "cinder-quobyte-03bfb5e0-2ad0-41f5-bd06-53d92c311db4" released by "delete_volume" :: held 1.527s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Delete snapshot completed successfully. Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8f10125-5f47-4fd5-b189-635fc67027e2 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-df5b7774-864b-45c7-8254-604c8c2e9511-delete_snapshot" released by "delete_snapshot" :: held 3.402s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Created reservations ['fe9c1315-cb40-4bf8-8138-80aba1c0b7d2', '190f2a40-342c-4a84-9730-37aa05c15d50', '42c56367-6c1a-4f16-bbb3-02d2dd9adbee', 'a459363f-675f-4a67-b86f-5133c0facbb7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:04 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:04 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:05 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.682s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Deleted volume successfully. Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e7fb55ec-4057-4e14-be2c-f6d3056a255f tempest-ProjectReaderTests-534094439 None] Lock "cinder-03bfb5e0-2ad0-41f5-bd06-53d92c311db4-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-b1856fae-326d-45bf-8137-73ceff5b43ef-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-b1856fae-326d-45bf-8137-73ceff5b43ef-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "cinder-quobyte-b1856fae-326d-45bf-8137-73ceff5b43ef" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-b1856fae-326d-45bf-8137-73ceff5b43ef" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28434ca-d754-4095-8705-196d988a52cf]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:05 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef Jul 10 19:55:05 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:06 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef" returned: 0 in 0.806s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:06 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef Jul 10 19:55:06 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:07 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1856fae-326d-45bf-8137-73ceff5b43ef" returned: 0 in 0.700s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-quobyte-b1856fae-326d-45bf-8137-73ceff5b43ef" released by "delete_volume" :: held 1.576s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Created reservations ['a0be982e-6a72-4994-97ed-3d3273d423f7', 'f1fd73d5-13ba-44d7-9182-2a3cbe1afc1d', '495bbca5-54aa-40a7-b377-ce018ac3c0e7', '65661200-c484-4355-aa84-ef5c00522a9a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:07 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:07 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:08 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.683s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:08 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Deleted volume successfully. Jul 10 19:55:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6e84d27f-62f2-4946-8a8d-887fc25cdd72 tempest-CreateVolumesFromSnapshotTest-2008516478 None] Lock "cinder-b1856fae-326d-45bf-8137-73ceff5b43ef-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (a563e543-1e92-488e-bbfc-c68f6ef7defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2acec6-e863-4131-9c4e-65a82849c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2acec6-e863-4131-9c4e-65a82849c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194065025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6041f1eb-56aa-4643-8051-364b9d26dd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:11Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7809b0f8-313c-4f5b-bd9e-aacea865a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7809b0f8-313c-4f5b-bd9e-aacea865a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4814b9a6-7bd4-4124-9bcf-05b315f8a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4814b9a6-7bd4-4124-9bcf-05b315f8a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6041f1eb-56aa-4643-8051-364b9d26dd4a', 'volume_name': 'volume-6041f1eb-56aa-4643-8051-364b9d26dd4a', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6a26a-a64a-49d7-81a0-1bd777ca1d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6a26a-a64a-49d7-81a0-1bd777ca1d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9af975-dcf3-4232-b6ea-c7910402c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:10 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume 6041f1eb-56aa-4643-8051-364b9d26dd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6041f1eb-56aa-4643-8051-364b9d26dd4a', 'volume_size': 1} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194065025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6041f1eb-56aa-4643-8051-364b9d26dd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:11Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Creating volume 6041f1eb-56aa-4643-8051-364b9d26dd4a {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:10 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:10 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a 1073741824 Jul 10 19:55:10 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:11 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a 1073741824" returned: 0 in 0.857s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:11 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a Jul 10 19:55:11 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:12 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9af975-dcf3-4232-b6ea-c7910402c46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6041f1eb-56aa-4643-8051-364b9d26dd4a', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446062fd-bc11-4ca7-a6b9-6a3dac44caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:12 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume volume-6041f1eb-56aa-4643-8051-364b9d26dd4a (6041f1eb-56aa-4643-8051-364b9d26dd4a): created successfully Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446062fd-bc11-4ca7-a6b9-6a3dac44caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:12 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (a563e543-1e92-488e-bbfc-c68f6ef7defe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bdbd8dac-693a-444a-93c2-1f4c8486ad23 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created volume successfully. Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (bd55eedd-d35d-442f-abb4-8c272823b417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc13aab-e318-4d39-8d96-a0ac8fad24a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc13aab-e318-4d39-8d96-a0ac8fad24a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708857620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0322a390-4bd1-4e50-b1f2-b5689214320d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:13Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2851465-60a6-4466-b571-34d5db045044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2851465-60a6-4466-b571-34d5db045044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf43b3bc-60b4-46fb-a384-a21124533fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf43b3bc-60b4-46fb-a384-a21124533fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0322a390-4bd1-4e50-b1f2-b5689214320d', 'volume_name': 'volume-0322a390-4bd1-4e50-b1f2-b5689214320d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed937fe9-5953-471d-bb56-5fc249a075b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed937fe9-5953-471d-bb56-5fc249a075b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e100ff6-377c-4b91-a597-37b1df111253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:13 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume 0322a390-4bd1-4e50-b1f2-b5689214320d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0322a390-4bd1-4e50-b1f2-b5689214320d', 'volume_size': 1} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708857620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0322a390-4bd1-4e50-b1f2-b5689214320d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:13Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Creating volume 0322a390-4bd1-4e50-b1f2-b5689214320d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:13 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:13 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d 1073741824 Jul 10 19:55:13 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (39c2331c-c2fb-4395-9008-d70d8366df69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad33003-b570-4721-8fff-f4f3d4e8e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad33003-b570-4721-8fff-f4f3d4e8e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427848311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d33ba5-122e-4ae4-acd6-2ff0ec80434c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:14Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86af796c-7e28-443c-b012-4cff7efdbc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86af796c-7e28-443c-b012-4cff7efdbc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bbbd18-3e79-4b75-9157-46bc47a43108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bbbd18-3e79-4b75-9157-46bc47a43108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d33ba5-122e-4ae4-acd6-2ff0ec80434c', 'volume_name': 'volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3443ec07-1a87-4630-ac9f-a4c680ee9979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3443ec07-1a87-4630-ac9f-a4c680ee9979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b53d07-041e-415c-b903-52adb27fd79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume e5d33ba5-122e-4ae4-acd6-2ff0ec80434c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c', 'volume_size': 1} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (4ec343ec-b05e-4127-87d8-bf24eb834647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54635d84-5ced-47cf-9749-4bea07eef2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54635d84-5ced-47cf-9749-4bea07eef2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730186962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e420cf0e-12c0-4d72-9b55-1f11527c0cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:14Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b64fc1-2273-4c3d-83c7-d1582346d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b64fc1-2273-4c3d-83c7-d1582346d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acec0a63-7a61-478f-b756-a682b84e6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acec0a63-7a61-478f-b756-a682b84e6398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e420cf0e-12c0-4d72-9b55-1f11527c0cc6', 'volume_name': 'volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba31baa-f924-485c-bcfd-beece8d3c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba31baa-f924-485c-bcfd-beece8d3c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923038db-8daa-4db1-aed9-f9374f256834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume e420cf0e-12c0-4d72-9b55-1f11527c0cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6', 'volume_size': 1} Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:14 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d 1073741824" returned: 0 in 1.315s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:15 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d Jul 10 19:55:15 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (c338a95e-f461-473a-b1b6-8f2f7a0e559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8a9569-b56b-4854-910d-c339ae3d188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8a9569-b56b-4854-910d-c339ae3d188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959981172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9ee1b6-1a46-40eb-a1df-3275ff11cb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:15Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba85405-651e-48b5-8271-a38d157b9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba85405-651e-48b5-8271-a38d157b9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d86c8e8-3d19-4290-917b-5b5dba9b6ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d86c8e8-3d19-4290-917b-5b5dba9b6ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9ee1b6-1a46-40eb-a1df-3275ff11cb48', 'volume_name': 'volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143295c1-8a7c-402c-b537-0085e2ff2287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143295c1-8a7c-402c-b537-0085e2ff2287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52ba080-089a-4e1a-b585-d94f078c5627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume 3e9ee1b6-1a46-40eb-a1df-3275ff11cb48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48', 'volume_size': 1} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (474076ee-ea50-4ccf-91f6-2f9238a2fae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9916e1d-21c8-43cf-846d-a094a0c540dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9916e1d-21c8-43cf-846d-a094a0c540dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400480123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1763553e-01a2-4992-8941-99511ed06f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:16Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f652fa66-95c3-4c00-a7b7-aed0b2d9fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f652fa66-95c3-4c00-a7b7-aed0b2d9fc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47041f24-7160-42ce-a2ab-5970b47af0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47041f24-7160-42ce-a2ab-5970b47af0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1763553e-01a2-4992-8941-99511ed06f4a', 'volume_name': 'volume-1763553e-01a2-4992-8941-99511ed06f4a', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6b95da-a5d0-48ae-8a6a-3ef459b7ec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6b95da-a5d0-48ae-8a6a-3ef459b7ec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f299c972-c7b2-421c-b371-997f4a95b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume 1763553e-01a2-4992-8941-99511ed06f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1763553e-01a2-4992-8941-99511ed06f4a', 'volume_size': 1} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:15 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d" returned: 0 in 0.928s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427848311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d33ba5-122e-4ae4-acd6-2ff0ec80434c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:14Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Creating volume e5d33ba5-122e-4ae4-acd6-2ff0ec80434c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:15 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e100ff6-377c-4b91-a597-37b1df111253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0322a390-4bd1-4e50-b1f2-b5689214320d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90f298d-8f79-4f0c-a9aa-7c5adfabd806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:16 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c 1073741824 Jul 10 19:55:16 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:16 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume volume-0322a390-4bd1-4e50-b1f2-b5689214320d (0322a390-4bd1-4e50-b1f2-b5689214320d): created successfully Jul 10 19:55:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90f298d-8f79-4f0c-a9aa-7c5adfabd806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (bd55eedd-d35d-442f-abb4-8c272823b417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a296bdf1-1fed-4c1e-b19f-66a6c8f3202b tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created volume successfully. Jul 10 19:55:16 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c 1073741824" returned: 0 in 0.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:17 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c Jul 10 19:55:17 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:17 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c" returned: 0 in 0.757s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.095s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730186962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e420cf0e-12c0-4d72-9b55-1f11527c0cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:14Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Creating volume e420cf0e-12c0-4d72-9b55-1f11527c0cc6 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:17 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b53d07-041e-415c-b903-52adb27fd79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ae9342-a9fb-4cb9-b6be-9383b070c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:17 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 1073741824 Jul 10 19:55:17 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:17 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c (e5d33ba5-122e-4ae4-acd6-2ff0ec80434c): created successfully Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ae9342-a9fb-4cb9-b6be-9383b070c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:17 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (39c2331c-c2fb-4395-9008-d70d8366df69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-35bcf50d-3ca9-4e21-ab4d-d0bf3db9293f tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created volume successfully. Jul 10 19:55:18 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 1073741824" returned: 0 in 0.967s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:18 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 Jul 10 19:55:18 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:19 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6" returned: 0 in 0.715s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959981172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9ee1b6-1a46-40eb-a1df-3275ff11cb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:15Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Creating volume 3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:19 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:19 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 1073741824 Jul 10 19:55:19 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923038db-8daa-4db1-aed9-f9374f256834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1713fd33-d768-4848-9bf7-4f9eb17d3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:19 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 (e420cf0e-12c0-4d72-9b55-1f11527c0cc6): created successfully Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1713fd33-d768-4848-9bf7-4f9eb17d3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:19 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (4ec343ec-b05e-4127-87d8-bf24eb834647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:19 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a0aa3db7-d780-48ff-95cf-7a02bebc5fe3 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created volume successfully. Jul 10 19:55:20 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 1073741824" returned: 0 in 0.891s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:20 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 Jul 10 19:55:20 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:21 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.443s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400480123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1763553e-01a2-4992-8941-99511ed06f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7852966e074b32aee8da54b49711dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:16Z,use_quota=True,user_id='2a322cb09ce44554b4397f93a655f1ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Creating volume 1763553e-01a2-4992-8941-99511ed06f4a {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:21 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:21 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a 1073741824 Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52ba080-089a-4e1a-b585-d94f078c5627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:21 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5dc8f8-4eb7-4f51-bceb-ff878782fb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 (3e9ee1b6-1a46-40eb-a1df-3275ff11cb48): created successfully Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5dc8f8-4eb7-4f51-bceb-ff878782fb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (c338a95e-f461-473a-b1b6-8f2f7a0e559c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-86495745-2a04-4cb5-9817-f265db131e24 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created volume successfully. Jul 10 19:55:22 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a 1073741824" returned: 0 in 0.920s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:22 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a Jul 10 19:55:22 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:22 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a" returned: 0 in 0.662s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f299c972-c7b2-421c-b371-997f4a95b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1763553e-01a2-4992-8941-99511ed06f4a', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd90c05-1d58-4016-a561-26c35faacc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Volume volume-1763553e-01a2-4992-8941-99511ed06f4a (1763553e-01a2-4992-8941-99511ed06f4a): created successfully Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd90c05-1d58-4016-a561-26c35faacc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Flow 'volume_create_manager' (474076ee-ea50-4ccf-91f6-2f9238a2fae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-20b70e77-ae6f-458c-a302-f931721acb8a tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created volume successfully. Jul 10 19:55:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-1763553e-01a2-4992-8941-99511ed06f4a-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-1763553e-01a2-4992-8941-99511ed06f4a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-quobyte-1763553e-01a2-4992-8941-99511ed06f4a" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:23 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-1763553e-01a2-4992-8941-99511ed06f4a" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4216b9-a230-4d1b-9997-5dc3b8e52791]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:23 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a Jul 10 19:55:23 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:24 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a" returned: 0 in 0.831s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:24 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a Jul 10 19:55:24 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:24 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1763553e-01a2-4992-8941-99511ed06f4a" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-1763553e-01a2-4992-8941-99511ed06f4a" released by "delete_volume" :: held 1.630s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created reservations ['74d8e3f2-2475-4fd4-9532-5409701945b2', 'a528d709-1cd2-4192-803b-10d8bace6717', '5aa32b63-5214-4cc9-aaa7-80e03d148fe6', 'f434dc35-5a0e-4fe1-a466-b3bc78602cf0'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:25 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:25 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-quobyte-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1955889-e154-4867-aba9-10d0fc7b5afd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:25 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 Jul 10 19:55:25 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:25 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.748s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Deleted volume successfully. Jul 10 19:55:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6c60ff2f-60e4-4ac7-819e-0692aad08e27 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-1763553e-01a2-4992-8941-99511ed06f4a-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:26 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48" returned: 0 in 0.893s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:26 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48 Jul 10 19:55:26 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:27 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48" returned: 0 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48" released by "delete_volume" :: held 1.712s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created reservations ['08919fc0-ff97-4b1a-8bf7-3c30e33af694', 'ef31387d-1e0f-4d65-8e57-bcfaad1e1927', '85065c90-78a7-42f5-bd78-50cc28e1dbdd', '5a0130b0-26c0-44e0-941e-7fda95c7c7dd'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:27 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:27 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Flow 'volume_create_manager' (5ab22177-4763-424a-9533-ffb8b0bce1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceb3777-65a1-42e6-8d18-aa1ea6ea346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceb3777-65a1-42e6-8d18-aa1ea6ea346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1416365088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b06ac9f-efd9-4b6d-8735-15ceb46ceee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbd205daaf146e5b267583fbe677fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:28Z,use_quota=True,user_id='bbe6f650682b439a8abf4612c55188ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2a13ee-ce1e-45d0-af94-ee1bc8232e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2a13ee-ce1e-45d0-af94-ee1bc8232e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df0ff63-6e30-4a63-b8c1-dd03adc08168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df0ff63-6e30-4a63-b8c1-dd03adc08168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b06ac9f-efd9-4b6d-8735-15ceb46ceee1', 'volume_name': 'volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06ebcd7-3506-4e1c-a0a1-ff633cb4c543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06ebcd7-3506-4e1c-a0a1-ff633cb4c543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5a7db3-31c1-4a2b-9b20-4831d465959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Volume 7b06ac9f-efd9-4b6d-8735-15ceb46ceee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1', 'volume_size': 1} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1416365088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b06ac9f-efd9-4b6d-8735-15ceb46ceee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbd205daaf146e5b267583fbe677fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:28Z,use_quota=True,user_id='bbe6f650682b439a8abf4612c55188ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Creating volume 7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:27 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:27 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 1073741824 Jul 10 19:55:27 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-e420cf0e-12c0-4d72-9b55-1f11527c0cc6-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-e420cf0e-12c0-4d72-9b55-1f11527c0cc6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-quobyte-e420cf0e-12c0-4d72-9b55-1f11527c0cc6" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-e420cf0e-12c0-4d72-9b55-1f11527c0cc6" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf5e5d-3725-4c66-9631-599fcba25141]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:28 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 Jul 10 19:55:28 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:28 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Deleted volume successfully. Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-827e5b4a-9531-4277-b947-fdf8b3146a48 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-3e9ee1b6-1a46-40eb-a1df-3275ff11cb48-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:28 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 1073741824" returned: 0 in 0.921s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:28 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:28 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:28 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6" returned: 0 in 0.873s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:28 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6 Jul 10 19:55:28 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:29 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.669s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5a7db3-31c1-4a2b-9b20-4831d465959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb67a5e-0032-4840-b030-56e53f140a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Volume volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 (7b06ac9f-efd9-4b6d-8735-15ceb46ceee1): created successfully Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb67a5e-0032-4840-b030-56e53f140a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Flow 'volume_create_manager' (5ab22177-4763-424a-9533-ffb8b0bce1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-99e2b690-1a50-4eeb-a89d-214b902e731f tempest-SnapshotDependencyTests-809488511 None] Created volume successfully. Jul 10 19:55:29 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e420cf0e-12c0-4d72-9b55-1f11527c0cc6" returned: 0 in 0.699s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-e420cf0e-12c0-4d72-9b55-1f11527c0cc6" released by "delete_volume" :: held 1.615s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created reservations ['ed6c5e12-5160-4458-bc45-4574ac070dc5', 'faf7baa2-56b8-43bd-97b7-8ef631fe7a5e', 'b800a9e0-5a25-4f54-a48d-c7d673cd3d6a', '4f2b13c1-cc16-4761-bba8-7c085b7d79d9'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:29 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:29 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Creating offline snapshot 97a2abf1-5666-483b-bf60-f7e2da0011ff of volume 7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8888b88-08cf-4eb1-8567-11f2afe1e573]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-quobyte-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efa8af0-744d-4abf-ac21-c6638e477684]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:30 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:30 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:30 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c Jul 10 19:55:30 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:30 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.812s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:30 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Deleted volume successfully. Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-613e2f34-559d-4152-b7f5-c169a105cc04 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-e420cf0e-12c0-4d72-9b55-1f11527c0cc6-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:30 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.937s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:30 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff 1G Jul 10 19:55:30 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:31 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c" returned: 0 in 0.839s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:31 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c Jul 10 19:55:31 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:31 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c" released by "delete_volume" :: held 1.583s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created reservations ['5025d039-af18-40e2-81a8-8ff6461bb5cb', '2b7e70a8-87d4-4673-9c45-dba4a04aa6ff', 'f3e75aa0-938a-4dae-b6f0-9149fc172c43', '1ca2dbd8-9542-4307-ac4e-a81536aaa9b2'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:31 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff 1G" returned: 0 in 0.824s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:31 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff Jul 10 19:55:31 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:31 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:31 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-0322a390-4bd1-4e50-b1f2-b5689214320d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-0322a390-4bd1-4e50-b1f2-b5689214320d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-quobyte-0322a390-4bd1-4e50-b1f2-b5689214320d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-0322a390-4bd1-4e50-b1f2-b5689214320d" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4297acf8-63e3-4257-a25d-63b61371a646]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:32 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff" returned: 0 in 0.762s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:32 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff is being set with open permissions: ugo+rw Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:32 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d Jul 10 19:55:32 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:32 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff Jul 10 19:55:32 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:32 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.720s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Deleted volume successfully. Jul 10 19:55:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3c92f0d9-3602-4d60-aa7e-592bb0553ac9 tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-e5d33ba5-122e-4ae4-acd6-2ff0ec80434c-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:33 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff" returned: 0 in 0.669s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:33 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d" returned: 0 in 0.787s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:33 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d Jul 10 19:55:33 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:33 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info Jul 10 19:55:33 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:33 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0322a390-4bd1-4e50-b1f2-b5689214320d" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-0322a390-4bd1-4e50-b1f2-b5689214320d" released by "delete_volume" :: held 1.506s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:33 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info" returned: 0 in 0.665s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:33 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info is being set with open permissions: ugo+rw Jul 10 19:55:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:33 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info Jul 10 19:55:33 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created reservations ['90442bb3-4c84-4aee-ac11-fd43eea8ace1', '38467934-912d-42c4-b59f-42df7f2f1a0e', 'e6bc81a6-29f6-4087-a79e-c1023b9a0ea9', 'ce1d08e6-708e-4113-bde8-64097495e3e6'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:34 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:34 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-6041f1eb-56aa-4643-8051-364b9d26dd4a-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-6041f1eb-56aa-4643-8051-364b9d26dd4a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:34 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.info" returned: 0 in 0.700s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.678s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "cinder-quobyte-6041f1eb-56aa-4643-8051-364b9d26dd4a" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-009d4fd7-8d52-4825-8b30-dc04d69a42b0 tempest-SnapshotDependencyTests-809488511 None] Create snapshot completed successfully Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-6041f1eb-56aa-4643-8051-364b9d26dd4a" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e6672-39ef-4c4d-811c-04d647fac08f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:34 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.666s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Deleted volume successfully. Jul 10 19:55:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c304fd69-5337-447a-8e3b-908a65d8e72e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-0322a390-4bd1-4e50-b1f2-b5689214320d-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:34 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a Jul 10 19:55:34 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:35 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a" returned: 0 in 0.802s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:35 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a Jul 10 19:55:35 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Flow 'volume_create_manager' (59768c73-2b2a-4675-829a-6be759ff395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4bec8d-c915-4484-9f54-70bf35b209cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4bec8d-c915-4484-9f54-70bf35b209cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e931e08c-9bb1-4b49-8e85-36bf2d542148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbd205daaf146e5b267583fbe677fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97a2abf1-5666-483b-bf60-f7e2da0011ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:36Z,use_quota=True,user_id='bbe6f650682b439a8abf4612c55188ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dad7dd9-a1e1-40aa-8667-ba367655237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dad7dd9-a1e1-40aa-8667-ba367655237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c718f9e0-bbf9-4d7e-a70a-08dde6042330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c718f9e0-bbf9-4d7e-a70a-08dde6042330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e931e08c-9bb1-4b49-8e85-36bf2d542148', 'volume_name': 'volume-e931e08c-9bb1-4b49-8e85-36bf2d542148', 'volume_size': 1, 'snapshot_id': '97a2abf1-5666-483b-bf60-f7e2da0011ff'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e831fe4-653c-4c8f-a8f9-3fb44486cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e831fe4-653c-4c8f-a8f9-3fb44486cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35bb80a-3478-46ef-8e77-7d1814a1b346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:35 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Volume e931e08c-9bb1-4b49-8e85-36bf2d542148: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e931e08c-9bb1-4b49-8e85-36bf2d542148', 'volume_size': 1, 'snapshot_id': '97a2abf1-5666-483b-bf60-f7e2da0011ff'} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-quobyte-97a2abf1-5666-483b-bf60-f7e2da0011ff-e931e08c-9bb1-4b49-8e85-36bf2d542148" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-97a2abf1-5666-483b-bf60-f7e2da0011ff-e931e08c-9bb1-4b49-8e85-36bf2d542148" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Creating volume e931e08c-9bb1-4b49-8e85-36bf2d542148 from snapshot 97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-quobyte-e931e08c-9bb1-4b49-8e85-36bf2d542148" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-e931e08c-9bb1-4b49-8e85-36bf2d542148" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] snapshot: 97a2abf1-5666-483b-bf60-f7e2da0011ff, volume: e931e08c-9bb1-4b49-8e85-36bf2d542148, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0659f6-3c07-47f7-b9b6-ad77432e878d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:36 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff Jul 10 19:55:36 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:36 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6041f1eb-56aa-4643-8051-364b9d26dd4a" returned: 0 in 0.707s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-quobyte-6041f1eb-56aa-4643-8051-364b9d26dd4a" released by "delete_volume" :: held 1.551s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Created reservations ['e1b0599d-8645-4a56-9341-a55228e84198', 'ed56c07a-6424-40d2-bfa5-64410aeab334', '51af3519-377c-4ac9-af6c-ef76b01847b0', '958a3594-5fb5-4be5-bf7c-421bd8bc8046'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:36 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:36 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:36 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff" returned: 0 in 0.857s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[299eb454-7cdc-4057-ab13-d192536d812b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:37 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:37 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:37 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Deleted volume successfully. Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-24fa4bd1-fd1f-4d07-a67c-d45e861b4f0e tempest-CreateVolumesFromSourceVolumeTest-528675323 None] Lock "cinder-6041f1eb-56aa-4643-8051-364b9d26dd4a-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:37 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:37 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:37 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.863s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:55:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:37 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 Jul 10 19:55:37 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:38 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.750s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:55:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:55:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:55:41 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Flow 'volume_create_manager' (ade83631-1f90-47ca-bb98-1bb72853b516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a1b8e1-1ff4-4327-a2c5-e6acc4164f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:41 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a1b8e1-1ff4-4327-a2c5-e6acc4164f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aa30f7-d6bd-4b63-9ace-e8e082df993f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a345a471194763b6fdd913b6c66fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:42Z,use_quota=True,user_id='95274ec56f3d4be9b78369d7f9cc7cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065cbdea-f638-476a-836d-2d6e699878ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065cbdea-f638-476a-836d-2d6e699878ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db156193-246d-4a49-a25c-8565bb5d4e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db156193-246d-4a49-a25c-8565bb5d4e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4aa30f7-d6bd-4b63-9ace-e8e082df993f', 'volume_name': 'volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43372358-7933-47bf-bf9c-c1276426b415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43372358-7933-47bf-bf9c-c1276426b415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958f5cf6-fb19-461b-8c69-1d7d5a867c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:42 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Volume a4aa30f7-d6bd-4b63-9ace-e8e082df993f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f', 'volume_size': 1} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:42 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148" returned: 0 in 5.078s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5848da-ee6e-4de5-95dd-f072de7002b9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:42 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:42 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:43 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.932s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:43 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:55:43 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Converted 1024.00 MB image at 201.61 MB/s Jul 10 19:55:43 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 is being set with open permissions: ugo+rw Jul 10 19:55:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:43 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 Jul 10 19:55:43 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:44 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148" returned: 0 in 0.639s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-e931e08c-9bb1-4b49-8e85-36bf2d542148" released by "_copy_volume_from_snapshot" :: held 8.470s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-97a2abf1-5666-483b-bf60-f7e2da0011ff-e931e08c-9bb1-4b49-8e85-36bf2d542148" released by "_create_volume_from_snapshot" :: held 8.498s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.516s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.391s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aa30f7-d6bd-4b63-9ace-e8e082df993f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a345a471194763b6fdd913b6c66fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:42Z,use_quota=True,user_id='95274ec56f3d4be9b78369d7f9cc7cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Creating volume a4aa30f7-d6bd-4b63-9ace-e8e082df993f {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:44 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:44 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f 1073741824 Jul 10 19:55:44 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35bb80a-3478-46ef-8e77-7d1814a1b346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e931e08c-9bb1-4b49-8e85-36bf2d542148', 'volume_size': 1, 'snapshot_id': '97a2abf1-5666-483b-bf60-f7e2da0011ff'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc51911-ec29-4fb7-b40b-bca79ff18e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:44 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Volume volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 (e931e08c-9bb1-4b49-8e85-36bf2d542148): created successfully Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc51911-ec29-4fb7-b40b-bca79ff18e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Flow 'volume_create_manager' (59768c73-2b2a-4675-829a-6be759ff395a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ae761b3b-83ac-4c8f-b90e-955dacc6f934 tempest-SnapshotDependencyTests-809488511 None] Created volume successfully. Jul 10 19:55:45 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f 1073741824" returned: 0 in 0.811s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:45 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f Jul 10 19:55:45 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-97a2abf1-5666-483b-bf60-f7e2da0011ff-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-97a2abf1-5666-483b-bf60-f7e2da0011ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-quobyte-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-quobyte-97a2abf1-5666-483b-bf60-f7e2da0011ff" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-97a2abf1-5666-483b-bf60-f7e2da0011ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Deleting offline snapshot 97a2abf1-5666-483b-bf60-f7e2da0011ff of volume 7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] snapshot_file for this snap is: volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc2f23-d24e-41bf-a257-5c9dccb9f587]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:45 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff Jul 10 19:55:45 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:45 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958f5cf6-fb19-461b-8c69-1d7d5a867c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ca0442-3e7a-437c-86c3-2f015eda3351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:46 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Volume volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f (a4aa30f7-d6bd-4b63-9ace-e8e082df993f): created successfully Jul 10 19:55:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ca0442-3e7a-437c-86c3-2f015eda3351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Flow 'volume_create_manager' (ade83631-1f90-47ca-bb98-1bb72853b516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c0482955-1ae0-4d7d-9cee-b635b6a08e2b tempest-CinderUnicodeTest-306731877 None] Created volume successfully. Jul 10 19:55:46 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:55:46 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d456ed6-c7be-49b4-b2ec-359129d880a3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:46 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:46 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:47 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:47 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff Jul 10 19:55:47 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Flow 'volume_create_manager' (80def61c-89b8-4b33-95de-c8bf36e37a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f5efbd-735d-402c-b6fd-f45adf5ae9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f5efbd-735d-402c-b6fd-f45adf5ae9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-893097135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4bff4f-d9ab-4f56-bda3-d810feea8e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a345a471194763b6fdd913b6c66fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:48Z,use_quota=True,user_id='95274ec56f3d4be9b78369d7f9cc7cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db509c99-9094-49a9-88b4-5731b33ee2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db509c99-9094-49a9-88b4-5731b33ee2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12ef952-59e1-48bb-8832-664d5c3c86f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12ef952-59e1-48bb-8832-664d5c3c86f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4bff4f-d9ab-4f56-bda3-d810feea8e3b', 'volume_name': 'volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb852ef-dd37-4f6c-a3ab-2b3893c5a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb852ef-dd37-4f6c-a3ab-2b3893c5a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6354cddb-cad4-43c0-8f9d-7f151a982846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Volume 5c4bff4f-d9ab-4f56-bda3-d810feea8e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b', 'volume_size': 1} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:55:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-893097135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4bff4f-d9ab-4f56-bda3-d810feea8e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a345a471194763b6fdd913b6c66fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:55:48Z,use_quota=True,user_id='95274ec56f3d4be9b78369d7f9cc7cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Creating volume 5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:55:47 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:55:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:47 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b 1073741824 Jul 10 19:55:47 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:48 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff" returned: 0 in 0.779s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:48 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff Jul 10 19:55:48 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:48 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b 1073741824" returned: 0 in 0.829s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:48 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b Jul 10 19:55:48 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:48 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1.97a2abf1-5666-483b-bf60-f7e2da0011ff" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-97a2abf1-5666-483b-bf60-f7e2da0011ff" released by "_delete_snapshot" :: held 3.170s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" released by "delete_snapshot" :: held 3.193s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:48 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Created reservations ['a17ea18a-c932-4b00-83d8-e6529b620bf4', 'b61ee656-6ded-44c7-a6d9-835456a96308', '9a42633c-2b93-470f-8e8b-e88e132fb9a2', '13c230f4-24e2-4dee-ab47-818642cc343d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Delete snapshot completed successfully. Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f7e407ce-03ec-4b93-a517-5e7ed79bc91f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-97a2abf1-5666-483b-bf60-f7e2da0011ff-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:49 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" returned: 0 in 0.669s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6354cddb-cad4-43c0-8f9d-7f151a982846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc25cae-28bd-4cd0-b0d4-28f345ff06e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:55:49 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Volume volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b (5c4bff4f-d9ab-4f56-bda3-d810feea8e3b): created successfully Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc25cae-28bd-4cd0-b0d4-28f345ff06e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Flow 'volume_create_manager' (80def61c-89b8-4b33-95de-c8bf36e37a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:55:49 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f68e003a-6647-4745-a7bc-1b3c17822122 tempest-CinderUnicodeTest-306731877 None] Created volume successfully. Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-quobyte-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[232421f0-9fa9-47c5-9cf8-b9601169ffae]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:50 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:50 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Creating offline snapshot 905bac45-4256-4cf9-8ecd-dca745c0026b of volume 5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e3632b-c8e2-4c74-ae89-549973bb9828]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:50 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b Jul 10 19:55:50 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:50 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:50 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1 Jul 10 19:55:50 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:50 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" returned: 0 in 0.777s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:51 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b 1G Jul 10 19:55:51 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:51 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" returned: 0 in 0.644s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1" released by "delete_volume" :: held 1.486s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Created reservations ['054930f5-b5bd-4f89-a182-c69e17826dd0', '98275b6f-f3c3-4b00-9b77-38c9a9759552', '3981f711-10b0-4521-bcd3-f99fb6d4cc18', 'c45be55b-a140-4a5a-88d7-ffcb8647e264'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:51 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:51 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:51 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b 1G" returned: 0 in 0.839s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:51 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b Jul 10 19:55:51 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-e931e08c-9bb1-4b49-8e85-36bf2d542148-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-e931e08c-9bb1-4b49-8e85-36bf2d542148-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "cinder-quobyte-e931e08c-9bb1-4b49-8e85-36bf2d542148" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-e931e08c-9bb1-4b49-8e85-36bf2d542148" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ed5619-1d5a-4184-b52a-0b1078e1975c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:52 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.746s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Deleted volume successfully. Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-81cd5c66-f3a2-4ef4-9638-cd9edf9f303f tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-7b06ac9f-efd9-4b6d-8735-15ceb46ceee1-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:52 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 Jul 10 19:55:52 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:52 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:52 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b is being set with open permissions: ugo+rw Jul 10 19:55:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:52 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b Jul 10 19:55:52 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:53 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148" returned: 0 in 0.784s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:53 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148 Jul 10 19:55:53 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:53 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b" returned: 0 in 0.690s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:53 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info Jul 10 19:55:53 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:53 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e931e08c-9bb1-4b49-8e85-36bf2d542148" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-quobyte-e931e08c-9bb1-4b49-8e85-36bf2d542148" released by "delete_volume" :: held 1.512s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Created reservations ['9cccb3f4-2c6d-48c5-8bb0-de1876fa8c02', '1be5e16b-0b4d-4cc0-b6a5-bd0a3fcfafb4', '92c776c9-80f1-430b-98fc-87cf14b68c21', '11f972a6-4205-4a12-8526-b4cbde658c02'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:53 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:55:53 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:53 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info" returned: 0 in 0.647s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:53 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info is being set with open permissions: ugo+rw Jul 10 19:55:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:53 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info Jul 10 19:55:53 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:54 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:54 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:55:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Deleted volume successfully. Jul 10 19:55:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a9e2afff-3cb6-419b-817a-e1122683b928 tempest-SnapshotDependencyTests-809488511 None] Lock "cinder-e931e08c-9bb1-4b49-8e85-36bf2d542148-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:54 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.info" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.533s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:55:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0db2a43e-c23d-4ea6-8eaf-339250d636fe tempest-CinderUnicodeTest-306731877 None] Create snapshot completed successfully Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-905bac45-4256-4cf9-8ecd-dca745c0026b-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Lock "cinder-905bac45-4256-4cf9-8ecd-dca745c0026b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-quobyte-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-quobyte-905bac45-4256-4cf9-8ecd-dca745c0026b" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-905bac45-4256-4cf9-8ecd-dca745c0026b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Deleting offline snapshot 905bac45-4256-4cf9-8ecd-dca745c0026b of volume 5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] snapshot_file for this snap is: volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6570a-1178-45b3-9ec3-ab2218adce85]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:55 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b Jul 10 19:55:55 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:56 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:55:56 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5df208-72d0-4f64-a31e-addab251f0d5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:56 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b Jul 10 19:55:56 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:57 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" returned: 0 in 0.859s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:57 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b Jul 10 19:55:57 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:58 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b" returned: 0 in 0.832s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:58 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b Jul 10 19:55:58 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:55:58 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b.905bac45-4256-4cf9-8ecd-dca745c0026b" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-905bac45-4256-4cf9-8ecd-dca745c0026b" released by "_delete_snapshot" :: held 3.310s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" released by "delete_snapshot" :: held 3.336s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Created reservations ['03244aeb-af8f-4798-aa87-d52ac03578e0', '33d120b8-0db1-4e3e-89ac-ea1c7315bbfe', 'd2542251-6d3e-425d-bfaf-93d07d27eb6e', '45a5def3-d770-4275-a403-0795f2c0f4a3'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:55:58 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Delete snapshot completed successfully. Jul 10 19:55:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc7e5361-afd6-4191-ae15-bc55376c25ad tempest-CinderUnicodeTest-306731877 None] Lock "cinder-905bac45-4256-4cf9-8ecd-dca745c0026b-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:55:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Lock "cinder-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-quobyte-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:55:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:55:59 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04243ea-436a-4c2a-a8fe-95dc16aa7191]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:55:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:55:59 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b Jul 10 19:55:59 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:00 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:00 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b Jul 10 19:56:00 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:01 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b" released by "delete_volume" :: held 1.611s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Created reservations ['486c4d50-ea56-42bf-a4c6-2061d26420e7', '686d0375-ea72-4480-8151-85357d4d43f9', '5d759dea-473f-4a60-96c5-9b2b01a1bef7', '299b5fc1-21af-4da4-8842-47e55d6faa20'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:01 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:01 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-a4aa30f7-d6bd-4b63-9ace-e8e082df993f-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Lock "cinder-a4aa30f7-d6bd-4b63-9ace-e8e082df993f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Acquiring lock "cinder-quobyte-a4aa30f7-d6bd-4b63-9ace-e8e082df993f" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-a4aa30f7-d6bd-4b63-9ace-e8e082df993f" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc2c62-09ff-40c4-86c9-937f8b9f1c77]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:02 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f Jul 10 19:56:02 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:02 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.704s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Deleted volume successfully. Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d214ea42-095f-483f-a197-2ac2e39348be tempest-CinderUnicodeTest-306731877 None] Lock "cinder-5c4bff4f-d9ab-4f56-bda3-d810feea8e3b-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:02 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f" returned: 0 in 0.836s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:02 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f Jul 10 19:56:02 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:03 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4aa30f7-d6bd-4b63-9ace-e8e082df993f" returned: 0 in 0.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Lock "cinder-quobyte-a4aa30f7-d6bd-4b63-9ace-e8e082df993f" released by "delete_volume" :: held 1.600s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Created reservations ['d031a2c2-cd6b-433c-b32f-4072680ac6fe', 'c7ffab67-563e-400d-92b7-0bef6f5e6c5e', '11468c66-bf38-466a-8c6e-36165a4db1f9', '51f5f602-7673-4552-a923-bef7c743d920'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:03 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:03 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:04 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.650s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:04 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Deleted volume successfully. Jul 10 19:56:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7271bbb5-f457-4da6-ab17-a6d464e89740 tempest-CinderUnicodeTest-306731877 None] Lock "cinder-a4aa30f7-d6bd-4b63-9ace-e8e082df993f-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:13 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=109,cinder:INSERT=38,cinder:UPDATE=142,cinder:DELETE=12 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:56:14 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=146,cinder:SELECT=95,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (bdb9c2c9-7ea6-4e2b-b094-0291f9476dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20194ea2-102a-472e-a994-d242836b75d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20194ea2-102a-472e-a994-d242836b75d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231912709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c112b4d6-81e0-4a37-aad2-ce63936e5838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:20Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d09e62-bf0f-4344-99e6-c78520cf411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d09e62-bf0f-4344-99e6-c78520cf411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50f6c8f-b2d9-4248-94cf-1d6eeb738d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50f6c8f-b2d9-4248-94cf-1d6eeb738d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c112b4d6-81e0-4a37-aad2-ce63936e5838', 'volume_name': 'volume-c112b4d6-81e0-4a37-aad2-ce63936e5838', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1d8e30-a0aa-4e21-a5ad-b2fa4c642f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1d8e30-a0aa-4e21-a5ad-b2fa4c642f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45ebb2f-5147-48fe-b61e-6fe6eaa2c95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume c112b4d6-81e0-4a37-aad2-ce63936e5838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c112b4d6-81e0-4a37-aad2-ce63936e5838', 'volume_size': 1} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231912709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c112b4d6-81e0-4a37-aad2-ce63936e5838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:20Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Creating volume c112b4d6-81e0-4a37-aad2-ce63936e5838 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:20 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:20 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 1073741824 Jul 10 19:56:20 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (52076ac9-2857-4148-9b98-e315cde9c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed5e77f-7613-4ff3-9866-c091f3243f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed5e77f-7613-4ff3-9866-c091f3243f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604544917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20da2ba1-c089-4669-a58d-9019c763d11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:20Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6918754-4c09-4afa-91e3-da564ef51bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6918754-4c09-4afa-91e3-da564ef51bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4204be18-6454-48b4-be6d-b678f32eeb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4204be18-6454-48b4-be6d-b678f32eeb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20da2ba1-c089-4669-a58d-9019c763d11e', 'volume_name': 'volume-20da2ba1-c089-4669-a58d-9019c763d11e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6401beb-795f-4daa-b204-ef8914a50c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6401beb-795f-4daa-b204-ef8914a50c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0a5a75-d196-4a97-9b62-65565cec0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Volume 20da2ba1-c089-4669-a58d-9019c763d11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20da2ba1-c089-4669-a58d-9019c763d11e', 'volume_size': 1} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (1a8186d2-06c1-41bb-bf01-5f0d2750ec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60303fc-ddd1-4311-a8fc-6ccb31452e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60303fc-ddd1-4311-a8fc-6ccb31452e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424579346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bcde7d-b307-47d5-bf81-d7f4abaa889e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:21Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db56fd97-4f54-4dc6-9333-6d45db0182dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db56fd97-4f54-4dc6-9333-6d45db0182dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d763a416-3e14-4baa-9c3a-f290f36d1a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d763a416-3e14-4baa-9c3a-f290f36d1a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bcde7d-b307-47d5-bf81-d7f4abaa889e', 'volume_name': 'volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37cc16a-f52b-4baa-90d6-c1a6a6b8b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37cc16a-f52b-4baa-90d6-c1a6a6b8b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e74b1e-0414-4d2c-855f-59ea41b99e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:20 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume 07bcde7d-b307-47d5-bf81-d7f4abaa889e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e', 'volume_size': 1} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:20 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (08e1d19c-e9e4-4003-b630-a02e66bd0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9d89ca-d053-46ea-89c1-1752025bae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9d89ca-d053-46ea-89c1-1752025bae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724018801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c39d75-8416-48e6-a678-1825c5085cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:21Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25235769-a0cc-4538-a85e-53af740557b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25235769-a0cc-4538-a85e-53af740557b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a187895-6842-4b3c-a3bf-65e7a999f421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a187895-6842-4b3c-a3bf-65e7a999f421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c39d75-8416-48e6-a678-1825c5085cf2', 'volume_name': 'volume-00c39d75-8416-48e6-a678-1825c5085cf2', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92f96a6-4369-4616-97d3-625f80936e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92f96a6-4369-4616-97d3-625f80936e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708cb8fa-9f31-4901-82f5-90190b7929fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Volume 00c39d75-8416-48e6-a678-1825c5085cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c39d75-8416-48e6-a678-1825c5085cf2', 'volume_size': 1} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:21 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (190fbaa9-79da-422a-ac42-2eaa2a875861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295563c5-f51d-4465-a044-6a49e561381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 1073741824" returned: 0 in 1.127s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295563c5-f51d-4465-a044-6a49e561381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-511331058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bc090c-e1ff-4234-899a-27407fa94adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:21Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddcd4f8-8a46-43bf-88de-4082e5802769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddcd4f8-8a46-43bf-88de-4082e5802769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca215f69-69e8-4123-b3c7-429449613a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca215f69-69e8-4123-b3c7-429449613a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92bc090c-e1ff-4234-899a-27407fa94adf', 'volume_name': 'volume-92bc090c-e1ff-4234-899a-27407fa94adf', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a5f891-5c65-477a-b7a4-02d4558573e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a5f891-5c65-477a-b7a4-02d4558573e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bc8bcf-b1c4-4345-85b4-81e2d5951408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Volume 92bc090c-e1ff-4234-899a-27407fa94adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92bc090c-e1ff-4234-899a-27407fa94adf', 'volume_size': 1} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:21 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 Jul 10 19:56:21 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (e68f09ae-c21e-4263-959c-880566d5a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba345d3c-667b-47ec-ab3a-9da5766708f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba345d3c-667b-47ec-ab3a-9da5766708f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1042429091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:22Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769bc482-0b0a-4b72-8406-a4c672d59bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769bc482-0b0a-4b72-8406-a4c672d59bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006f9e4f-1b4a-4501-bf79-e105d08dd7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006f9e4f-1b4a-4501-bf79-e105d08dd7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b', 'volume_name': 'volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c62c958-b315-4d7c-a8cc-8a8de96651ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c62c958-b315-4d7c-a8cc-8a8de96651ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f903fc2b-1bd7-4c8a-8604-9fa77d05fe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Volume 1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b', 'volume_size': 1} Jul 10 19:56:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (387b4090-e5d6-4baa-8948-ea525b3a7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8577a3d-9cca-4653-85b7-56b1b6ee5f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8577a3d-9cca-4653-85b7-56b1b6ee5f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-814105599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e8700d-a48e-427f-b0b5-8ede20372a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:22Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c82dea-1dba-4851-8222-da4edc03cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c82dea-1dba-4851-8222-da4edc03cd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261f625d-edea-48ab-8772-cd5ed3812ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261f625d-edea-48ab-8772-cd5ed3812ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e8700d-a48e-427f-b0b5-8ede20372a4e', 'volume_name': 'volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4d6ba3-e514-41fe-87f2-2970fbc10110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4d6ba3-e514-41fe-87f2-2970fbc10110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:22 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a493852-c865-4fe5-bd64-2566fa0c1b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Volume f6e8700d-a48e-427f-b0b5-8ede20372a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e', 'volume_size': 1} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838" returned: 0 in 0.833s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.914s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604544917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20da2ba1-c089-4669-a58d-9019c763d11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:20Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Creating volume 20da2ba1-c089-4669-a58d-9019c763d11e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:22 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45ebb2f-5147-48fe-b61e-6fe6eaa2c95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c112b4d6-81e0-4a37-aad2-ce63936e5838', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4a35e0-e7e6-4733-934b-cbc7f84a7207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:22 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e 1073741824 Jul 10 19:56:22 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 (c112b4d6-81e0-4a37-aad2-ce63936e5838): created successfully Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4a35e0-e7e6-4733-934b-cbc7f84a7207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (bdb9c2c9-7ea6-4e2b-b094-0291f9476dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1e27540e-476b-47d0-a955-e8067ed724dd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created volume successfully. Jul 10 19:56:23 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e 1073741824" returned: 0 in 0.893s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:23 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e Jul 10 19:56:23 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (58e08c6d-408f-4cd4-b76c-5bada60f25be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ef6978-1f16-4480-a9b0-90cb5c3adc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ef6978-1f16-4480-a9b0-90cb5c3adc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801453673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dded584-22cb-4d68-a70a-b81b496a42db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:24Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221fce0e-0964-4412-93df-d183569117e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221fce0e-0964-4412-93df-d183569117e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd434c6-bfc4-4593-9591-ad794f618fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd434c6-bfc4-4593-9591-ad794f618fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dded584-22cb-4d68-a70a-b81b496a42db', 'volume_name': 'volume-8dded584-22cb-4d68-a70a-b81b496a42db', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa096881-4566-4918-a611-b29e18121f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa096881-4566-4918-a611-b29e18121f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ecd92c-9776-43e3-a9bf-30b78337e2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume 8dded584-22cb-4d68-a70a-b81b496a42db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dded584-22cb-4d68-a70a-b81b496a42db', 'volume_size': 1} Jul 10 19:56:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:24 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e" returned: 0 in 0.777s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.318s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424579346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bcde7d-b307-47d5-bf81-d7f4abaa889e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:21Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating volume 07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:24 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0a5a75-d196-4a97-9b62-65565cec0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20da2ba1-c089-4669-a58d-9019c763d11e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416d4de9-2e19-4ac9-be34-5e9f54527565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e 1073741824 Jul 10 19:56:24 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Volume volume-20da2ba1-c089-4669-a58d-9019c763d11e (20da2ba1-c089-4669-a58d-9019c763d11e): created successfully Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416d4de9-2e19-4ac9-be34-5e9f54527565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (52076ac9-2857-4148-9b98-e315cde9c888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b61165c5-ae3d-4fdd-83da-80e5a146cd52 tempest-CreateVolumesFromImageTest-2086430662 None] Created volume successfully. Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (6e72f733-45f6-4473-b4f0-75d0e66588f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684ead47-030c-44e3-82c1-a66fc63047ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684ead47-030c-44e3-82c1-a66fc63047ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779471928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44065f7-d5e3-4b96-babe-4da2d77ec93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:24Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e73dc8-3d63-4af3-b1c1-a756b7dadd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e73dc8-3d63-4af3-b1c1-a756b7dadd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0717562c-fda5-448d-b278-18ae0a59f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0717562c-fda5-448d-b278-18ae0a59f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44065f7-d5e3-4b96-babe-4da2d77ec93d', 'volume_name': 'volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965bc606-0cbc-41bb-b4d7-b21a7d30d639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965bc606-0cbc-41bb-b4d7-b21a7d30d639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f9e737-39bb-4c9a-95f4-ff77eaab121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume a44065f7-d5e3-4b96-babe-4da2d77ec93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d', 'volume_size': 1} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Flow 'volume_create_manager' (9d52316f-1be3-4d11-92b2-a280078e6c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a28be9-622c-49e0-b9c8-e17fb0358610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a28be9-622c-49e0-b9c8-e17fb0358610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a20171d-9c55-4cac-ba8d-98e30e7a6e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28c7e5c61e1445f9f2fa7d2b2b03b58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:24Z,use_quota=True,user_id='4d8dfbbf9a9b4a6d90b3a0863c732b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a312c39e-db2c-4880-9e20-5da18434d195),volume_type_id=a312c39e-db2c-4880-9e20-5da18434d195)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adcfd3a-3af5-46ca-a26d-e97db2e8423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adcfd3a-3af5-46ca-a26d-e97db2e8423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b5e969-e2b5-4bd0-9973-b2c6da107105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (5ca2a567-87a4-4f64-ae22-9dd01b414ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038990cb-dc93-4c05-843e-626592547fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038990cb-dc93-4c05-843e-626592547fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1443639640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f0bd66-49f6-4961-8d8e-0ce18841eb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:25Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebb9e89-aac9-4bff-a5bc-3a9bc29bef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebb9e89-aac9-4bff-a5bc-3a9bc29bef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5f65a-c434-4565-ba55-683e2d7ce8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5f65a-c434-4565-ba55-683e2d7ce8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f0bd66-49f6-4961-8d8e-0ce18841eb40', 'volume_name': 'volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28590c5d-75b1-485e-8b96-5edf97cd9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28590c5d-75b1-485e-8b96-5edf97cd9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8e11b6-9bc8-4e0b-b1b5-419b2e243d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume 62f0bd66-49f6-4961-8d8e-0ce18841eb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40', 'volume_size': 1} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b5e969-e2b5-4bd0-9973-b2c6da107105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a20171d-9c55-4cac-ba8d-98e30e7a6e5c', 'volume_name': 'volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c', 'volume_size': 1, 'image_id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '180c2a051cdf5136f201bba107fc5e7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e28c7e5c61e1445f9f2fa7d2b2b03b58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '130744119f6ac590c8d449785d09848eed0a9da40f9828af48a9160ab88324e3b2b9ddc2c260c99f4a5c8bf7c6fdceeca2cc2c32988d345583a4c1d2caa47241', 'id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'created_at': datetime.datetime(2026, 7, 10, 17, 56, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195677bb-734a-423a-a499-8e2c069f4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195677bb-734a-423a-a499-8e2c069f4d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a075365b-2398-401b-ac85-284b4f1743fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Volume 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c', 'volume_size': 1, 'image_id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '180c2a051cdf5136f201bba107fc5e7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e28c7e5c61e1445f9f2fa7d2b2b03b58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '130744119f6ac590c8d449785d09848eed0a9da40f9828af48a9160ab88324e3b2b9ddc2c260c99f4a5c8bf7c6fdceeca2cc2c32988d345583a4c1d2caa47241', 'id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'created_at': datetime.datetime(2026, 7, 10, 17, 56, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Trying to clone 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c from image 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:56:25 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Image download 0.00 MB at 0.00 MB/s Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (f4a2996d-ef47-4632-bf32-67804e838718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48f72e1-9b82-4687-b55b-1362b4a6e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f24a80-642f-4e66-927d-2835e8d8a5fb]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48f72e1-9b82-4687-b55b-1362b4a6e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48021622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827568e0-dc67-483f-bb21-4bb4ef3acd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:25Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993c1f96-16ea-4e33-b057-80fff673a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993c1f96-16ea-4e33-b057-80fff673a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4fcda7-4b76-4916-8334-1f47a57119ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4fcda7-4b76-4916-8334-1f47a57119ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827568e0-dc67-483f-bb21-4bb4ef3acd80', 'volume_name': 'volume-827568e0-dc67-483f-bb21-4bb4ef3acd80', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff039626-bc7c-41cd-ad41-a533b5dad6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff039626-bc7c-41cd-ad41-a533b5dad6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c992c1-9708-4e54-91e5-f22df64530cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume 827568e0-dc67-483f-bb21-4bb4ef3acd80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827568e0-dc67-483f-bb21-4bb4ef3acd80', 'volume_size': 1} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:25 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD Jul 10 19:56:25 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:25 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e 1073741824" returned: 0 in 1.234s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:25 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e Jul 10 19:56:25 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (fc3366db-bf45-4ce4-a116-39490be16a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e74e603-de75-401b-a564-467766f64826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e74e603-de75-401b-a564-467766f64826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246094523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23942942-7a1a-4e97-b334-73ca0b1e01bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:26Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb171143-61b5-44f8-bbbb-988916e8b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb171143-61b5-44f8-bbbb-988916e8b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5402cbcf-36d0-4f4f-a285-399e2fc0b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5402cbcf-36d0-4f4f-a285-399e2fc0b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23942942-7a1a-4e97-b334-73ca0b1e01bd', 'volume_name': 'volume-23942942-7a1a-4e97-b334-73ca0b1e01bd', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6247f73-0079-4910-a797-9b706e83d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6247f73-0079-4910-a797-9b706e83d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381819ad-2586-432f-8890-353cc8347bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume 23942942-7a1a-4e97-b334-73ca0b1e01bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23942942-7a1a-4e97-b334-73ca0b1e01bd', 'volume_size': 1} Jul 10 19:56:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:26 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:26 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e" returned: 0 in 0.704s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.043s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724018801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c39d75-8416-48e6-a678-1825c5085cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:21Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Creating volume 00c39d75-8416-48e6-a678-1825c5085cf2 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:26 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:26 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD Jul 10 19:56:26 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:26 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 1073741824 Jul 10 19:56:26 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e74b1e-0414-4d2c-855f-59ea41b99e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1777278-d6a6-4ddc-93f1-703030a3db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:26 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e (07bcde7d-b307-47d5-bf81-d7f4abaa889e): created successfully Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1777278-d6a6-4ddc-93f1-703030a3db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (1a8186d2-06c1-41bb-bf01-5f0d2750ec06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9ee939a6-a40d-4761-a523-18bca110daf5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created volume successfully. Jul 10 19:56:26 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Temporary image 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 is fetched for user 4d8dfbbf9a9b4a6d90b3a0863c732b13. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ce3395-dd6b-4fb0-b855-15b12ef3f960]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:26 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 1073741824" returned: 0 in 0.836s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:27 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD Jul 10 19:56:27 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:27 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 Jul 10 19:56:27 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:27 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:27 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.225s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-511331058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92bc090c-e1ff-4234-899a-27407fa94adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:21Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Creating volume 92bc090c-e1ff-4234-899a-27407fa94adf {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:27 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:27 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD Jul 10 19:56:27 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708cb8fa-9f31-4901-82f5-90190b7929fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c39d75-8416-48e6-a678-1825c5085cf2', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:27 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf 1073741824 Jul 10 19:56:27 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b654812d-1b91-490d-96c1-88b70592f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Volume volume-00c39d75-8416-48e6-a678-1825c5085cf2 (00c39d75-8416-48e6-a678-1825c5085cf2): created successfully Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b654812d-1b91-490d-96c1-88b70592f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (08e1d19c-e9e4-4003-b630-a02e66bd0f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:27 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-05015e28-23d0-491e-9a4b-d34d104a2880 tempest-CreateVolumesFromImageTest-2086430662 None] Created volume successfully. Jul 10 19:56:28 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD" returned: 1 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:56:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:28 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf 1073741824" returned: 0 in 0.871s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:28 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf Jul 10 19:56:28 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:29 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf" returned: 0 in 0.643s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.350s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1042429091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:22Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Creating volume 1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:29 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bc8bcf-b1c4-4345-85b4-81e2d5951408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92bc090c-e1ff-4234-899a-27407fa94adf', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:29 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b 1073741824 Jul 10 19:56:29 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34232a61-4911-4b86-ba00-98a76b8e6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:29 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Volume volume-92bc090c-e1ff-4234-899a-27407fa94adf (92bc090c-e1ff-4234-899a-27407fa94adf): created successfully Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34232a61-4911-4b86-ba00-98a76b8e6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:29 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (190fbaa9-79da-422a-ac42-2eaa2a875861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:29 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5c679c29-5d91-4751-ac98-40c0426ee05d tempest-CreateVolumesFromImageTest-2086430662 None] Created volume successfully. Jul 10 19:56:30 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b 1073741824" returned: 0 in 0.846s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:30 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b Jul 10 19:56:30 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:30 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b" returned: 0 in 0.672s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.547s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-814105599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e8700d-a48e-427f-b0b5-8ede20372a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c63cc8e4af47318c52f92b8654784d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:22Z,use_quota=True,user_id='214b36247c38489f852cd2ae29911906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Creating volume f6e8700d-a48e-427f-b0b5-8ede20372a4e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:30 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:30 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e 1073741824 Jul 10 19:56:30 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:30 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f903fc2b-1bd7-4c8a-8604-9fa77d05fe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c45cc1-2f86-419e-9415-df8e65cde0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:31 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Volume volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b (1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b): created successfully Jul 10 19:56:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c45cc1-2f86-419e-9415-df8e65cde0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:31 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (e68f09ae-c21e-4263-959c-880566d5a255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:31 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c3fb753e-ac51-4fe6-b832-c0245ada02ef tempest-CreateVolumesFromImageTest-2086430662 None] Created volume successfully. Jul 10 19:56:31 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e 1073741824" returned: 0 in 0.868s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:31 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e Jul 10 19:56:31 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:32 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e" returned: 0 in 0.651s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.564s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-801453673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dded584-22cb-4d68-a70a-b81b496a42db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:24Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Creating volume 8dded584-22cb-4d68-a70a-b81b496a42db {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:32 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a493852-c865-4fe5-bd64-2566fa0c1b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:32 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db 1073741824 Jul 10 19:56:32 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f39e7e-c9fa-40bb-aff1-7cfa544dacfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Volume volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e (f6e8700d-a48e-427f-b0b5-8ede20372a4e): created successfully Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f39e7e-c9fa-40bb-aff1-7cfa544dacfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Flow 'volume_create_manager' (387b4090-e5d6-4baa-8948-ea525b3a7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a31dac60-515a-46ac-9ba5-0df8c8028859 tempest-CreateVolumesFromImageTest-2086430662 None] Created volume successfully. Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-f6e8700d-a48e-427f-b0b5-8ede20372a4e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-f6e8700d-a48e-427f-b0b5-8ede20372a4e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-quobyte-f6e8700d-a48e-427f-b0b5-8ede20372a4e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-f6e8700d-a48e-427f-b0b5-8ede20372a4e" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3696f53e-dafa-4055-a98f-44a9ae773652]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:33 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db 1073741824" returned: 0 in 0.854s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:33 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db Jul 10 19:56:33 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:33 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e Jul 10 19:56:33 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:34 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db" returned: 0 in 0.637s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.577s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779471928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44065f7-d5e3-4b96-babe-4da2d77ec93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:24Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Creating volume a44065f7-d5e3-4b96-babe-4da2d77ec93d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:34 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:34 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d 1073741824 Jul 10 19:56:34 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ecd92c-9776-43e3-a9bf-30b78337e2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dded584-22cb-4d68-a70a-b81b496a42db', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73d3a48-eccc-4333-96a0-65083af50b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:34 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume volume-8dded584-22cb-4d68-a70a-b81b496a42db (8dded584-22cb-4d68-a70a-b81b496a42db): created successfully Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73d3a48-eccc-4333-96a0-65083af50b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (58e08c6d-408f-4cd4-b76c-5bada60f25be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:34 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e" returned: 0 in 0.832s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ce140bf4-9e6f-4bd0-a30f-87c2e2345b6b tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created volume successfully. Jul 10 19:56:34 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e Jul 10 19:56:34 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:34 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-f6e8700d-a48e-427f-b0b5-8ede20372a4e" returned: 0 in 0.679s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-f6e8700d-a48e-427f-b0b5-8ede20372a4e" released by "delete_volume" :: held 1.559s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:34 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d 1073741824" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Created reservations ['c22f9287-df9d-4074-823f-1e819c4c7af1', '927e4036-6937-4e21-901c-77e9c5bdae72', '4a8420c4-c2be-4b22-a594-fda38208f270', 'e2e9d72a-53f8-4410-8ae2-3ec444b2bc80'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:34 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d Jul 10 19:56:34 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:35 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:35 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-quobyte-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5bc32-dae6-4845-85de-065a15f2f35c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:35 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.811s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1443639640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f0bd66-49f6-4961-8d8e-0ce18841eb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:25Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Creating volume 62f0bd66-49f6-4961-8d8e-0ce18841eb40 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:35 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f9e737-39bb-4c9a-95f4-ff77eaab121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:35 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 1073741824 Jul 10 19:56:35 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371c3d25-5d07-4976-96ec-585c633a5e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:35 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d (a44065f7-d5e3-4b96-babe-4da2d77ec93d): created successfully Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371c3d25-5d07-4976-96ec-585c633a5e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (6e72f733-45f6-4473-b4f0-75d0e66588f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:35 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-607c0918-4e2b-4e70-b70c-b59633013b95 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created volume successfully. Jul 10 19:56:35 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b Jul 10 19:56:35 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:35 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.729s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:35 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Deleted volume successfully. Jul 10 19:56:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-af47b678-2a0e-4e2f-9992-7af4d10333c0 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-f6e8700d-a48e-427f-b0b5-8ede20372a4e-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:36 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b" returned: 0 in 0.827s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:36 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b Jul 10 19:56:36 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:36 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 1073741824" returned: 0 in 0.923s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:36 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 Jul 10 19:56:36 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:37 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b" returned: 0 in 0.689s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b" released by "delete_volume" :: held 1.570s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Created reservations ['13e4842a-546f-4fe6-ac9a-6ed3c94cb27c', '56059636-2b79-4466-b08c-d0b51c09b2a2', '9b55fa10-d76a-4be5-9a5f-30c89442cde7', '99873474-f1ea-4ae5-990c-9b169e1e7254'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:37 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40" returned: 0 in 0.672s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.997s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48021622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827568e0-dc67-483f-bb21-4bb4ef3acd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:25Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Creating volume 827568e0-dc67-483f-bb21-4bb4ef3acd80 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:37 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:37 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:37 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8e11b6-9bc8-4e0b-b1b5-419b2e243d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:37 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 1073741824 Jul 10 19:56:37 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46772422-753e-4277-af08-74ffc56b5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:37 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 (62f0bd66-49f6-4961-8d8e-0ce18841eb40): created successfully Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46772422-753e-4277-af08-74ffc56b5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (5ca2a567-87a4-4f64-ae22-9dd01b414ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:37 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7d8245d9-c994-438a-91fe-7babb96991c0 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created volume successfully. Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:37 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:37 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-92bc090c-e1ff-4234-899a-27407fa94adf-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-92bc090c-e1ff-4234-899a-27407fa94adf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-quobyte-92bc090c-e1ff-4234-899a-27407fa94adf" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-92bc090c-e1ff-4234-899a-27407fa94adf" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d14acb-81df-4459-bb30-ea40238886bf]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:38 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.779s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:38 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf Jul 10 19:56:38 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Deleted volume successfully. Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c4259b81-d771-4979-854d-f4bd0d950fe4 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-1fbcdc94-7dd5-43fc-a5c1-2262a5d8474b-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:38 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 1073741824" returned: 0 in 0.987s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:38 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 Jul 10 19:56:38 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:38 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:56:38 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf" returned: 0 in 0.885s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:38 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf Jul 10 19:56:38 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:39 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80" returned: 0 in 0.705s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.371s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246094523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23942942-7a1a-4e97-b334-73ca0b1e01bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c6195083ce418da189d50c3cacd1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:26Z,use_quota=True,user_id='fb944770096c42ba8059657a4c068a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Creating volume 23942942-7a1a-4e97-b334-73ca0b1e01bd {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:39 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:39 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd 1073741824 Jul 10 19:56:39 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c992c1-9708-4e54-91e5-f22df64530cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827568e0-dc67-483f-bb21-4bb4ef3acd80', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99beadee-30a9-4dc8-807f-c0237482585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:39 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 (827568e0-dc67-483f-bb21-4bb4ef3acd80): created successfully Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99beadee-30a9-4dc8-807f-c0237482585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (f4a2996d-ef47-4632-bf32-67804e838718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:39 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c49cc953-6d6b-4fb3-ba0c-c6147dfbb9bd tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created volume successfully. Jul 10 19:56:39 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-92bc090c-e1ff-4234-899a-27407fa94adf" returned: 0 in 0.678s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-92bc090c-e1ff-4234-899a-27407fa94adf" released by "delete_volume" :: held 1.616s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Created reservations ['af267e2e-97a1-4dd7-b79b-f0e9ecca8f07', 'cf2a4f5d-03b0-4340-8ba6-145781156d90', 'ea6ed542-fde3-47a1-84bc-2529d11db3fb', 'd21b86e9-839a-4156-a6e5-afe24cda2b37'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:39 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:39 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:39 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd 1073741824" returned: 0 in 0.842s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:39 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd Jul 10 19:56:39 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-00c39d75-8416-48e6-a678-1825c5085cf2-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-00c39d75-8416-48e6-a678-1825c5085cf2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-quobyte-00c39d75-8416-48e6-a678-1825c5085cf2" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-00c39d75-8416-48e6-a678-1825c5085cf2" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7c781-e35f-4f2f-9c7a-d7faeead2910]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:40 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 Jul 10 19:56:40 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:40 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.715s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Deleted volume successfully. Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a1ff228d-f09c-4216-9c86-a017b7275e23 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-92bc090c-e1ff-4234-899a-27407fa94adf-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:40 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd" returned: 0 in 0.733s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.029s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating offline snapshot 58e01601-3a84-468f-b6fa-223d807494f5 of volume 07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381819ad-2586-432f-8890-353cc8347bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23942942-7a1a-4e97-b334-73ca0b1e01bd', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f97bc-ccdb-48cd-8561-d1f47e0183e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c7b6f-780a-465d-84a9-e411bd14ec5c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:40 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Volume volume-23942942-7a1a-4e97-b334-73ca0b1e01bd (23942942-7a1a-4e97-b334-73ca0b1e01bd): created successfully Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f97bc-ccdb-48cd-8561-d1f47e0183e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Flow 'volume_create_manager' (fc3366db-bf45-4ce4-a116-39490be16a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-07e6701d-72c9-4845-afab-77edb1c780af tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created volume successfully. Jul 10 19:56:40 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e Jul 10 19:56:40 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:40 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2" returned: 0 in 0.823s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:40 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2 Jul 10 19:56:41 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:41 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:41 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 1G Jul 10 19:56:41 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:41 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-00c39d75-8416-48e6-a678-1825c5085cf2" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-00c39d75-8416-48e6-a678-1825c5085cf2" released by "delete_volume" :: held 1.553s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Created reservations ['3e3f9aa6-886d-41af-aff7-a6b4db23b561', '2186b239-80b2-494d-b09d-ce44d1dc65d5', '06480d1d-f54d-4cd3-9b10-d3ba489b6529', '50713cbf-50bc-4aee-ad4a-a1b8d4a3dc7b'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:41 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:41 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-23942942-7a1a-4e97-b334-73ca0b1e01bd-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-23942942-7a1a-4e97-b334-73ca0b1e01bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-quobyte-23942942-7a1a-4e97-b334-73ca0b1e01bd" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-23942942-7a1a-4e97-b334-73ca0b1e01bd" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[26310b9f-d1de-4ced-84e2-0bc7c8d46465]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:42 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd Jul 10 19:56:42 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-20da2ba1-c089-4669-a58d-9019c763d11e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-20da2ba1-c089-4669-a58d-9019c763d11e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "cinder-quobyte-20da2ba1-c089-4669-a58d-9019c763d11e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-20da2ba1-c089-4669-a58d-9019c763d11e" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[00865c15-aa68-4391-96e1-7a567e2bfcde]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:42 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 1G" returned: 0 in 0.962s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:42 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 Jul 10 19:56:42 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:42 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:42 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e Jul 10 19:56:42 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Deleted volume successfully. Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b1dceaff-2e44-48f0-b2be-50c4e1814501 tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-00c39d75-8416-48e6-a678-1825c5085cf2-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:42 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd" returned: 0 in 0.940s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:43 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd Jul 10 19:56:43 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:43 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5" returned: 0 in 0.756s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:43 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 is being set with open permissions: ugo+rw Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:43 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 Jul 10 19:56:43 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:43 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e" returned: 0 in 0.819s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:43 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e Jul 10 19:56:43 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:43 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-23942942-7a1a-4e97-b334-73ca0b1e01bd" returned: 0 in 0.720s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-23942942-7a1a-4e97-b334-73ca0b1e01bd" released by "delete_volume" :: held 1.708s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created reservations ['6b9b4bdc-d121-4c03-8c55-719605ffee96', '147f9e71-bc46-4288-9093-dc84ec79c7d3', 'a62b6c56-e6ac-4f17-947e-6e8a49c4e70b', '78c7139b-3d95-4228-a603-573a01fbd2cf'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:43 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:43 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:43 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5" returned: 0 in 0.697s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:44 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info Jul 10 19:56:44 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:44 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-20da2ba1-c089-4669-a58d-9019c763d11e" returned: 0 in 0.749s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-quobyte-20da2ba1-c089-4669-a58d-9019c763d11e" released by "delete_volume" :: held 1.631s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Created reservations ['a6931cff-62d5-4c9f-ba35-33216cd18bdf', '162727c8-a58f-4710-bd55-4a5183ef0947', 'ce278d53-c95d-45aa-ae5d-4f116819ddab', '34918177-1d5f-4cb8-869f-c3827c812e68'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-827568e0-dc67-483f-bb21-4bb4ef3acd80-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-827568e0-dc67-483f-bb21-4bb4ef3acd80-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:44 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:44 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-quobyte-827568e0-dc67-483f-bb21-4bb4ef3acd80" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-827568e0-dc67-483f-bb21-4bb4ef3acd80" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9261d7-c782-4812-ac72-93d8a177507d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:44 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 Jul 10 19:56:44 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:44 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.877s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Deleted volume successfully. Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a74943cb-37a7-4199-bcf4-8d83ebac8f21 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-23942942-7a1a-4e97-b334-73ca0b1e01bd-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:44 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info" returned: 0 in 0.795s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:44 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info is being set with open permissions: ugo+rw Jul 10 19:56:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:44 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info Jul 10 19:56:44 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:45 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.851s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Deleted volume successfully. Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2c44b603-2047-47f9-8aa1-1407ed1ffebc tempest-CreateVolumesFromImageTest-2086430662 None] Lock "cinder-20da2ba1-c089-4669-a58d-9019c763d11e-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:45 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80" returned: 0 in 0.987s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:45 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80 Jul 10 19:56:45 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:45 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.info" returned: 0 in 0.861s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.187s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a20171d-9c55-4cac-ba8d-98e30e7a6e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28c7e5c61e1445f9f2fa7d2b2b03b58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:24Z,use_quota=True,user_id='4d8dfbbf9a9b4a6d90b3a0863c732b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a312c39e-db2c-4880-9e20-5da18434d195),volume_type_id=a312c39e-db2c-4880-9e20-5da18434d195)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Creating volume 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:45 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:45 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c 1073741824 Jul 10 19:56:45 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6a497d92-e253-4e2c-9e23-f5d8e883a5ad tempest-CreateVolumesFromSnapshotTest-694320618 None] Create snapshot completed successfully Jul 10 19:56:46 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-827568e0-dc67-483f-bb21-4bb4ef3acd80" returned: 0 in 0.768s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-827568e0-dc67-483f-bb21-4bb4ef3acd80" released by "delete_volume" :: held 1.801s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created reservations ['f3575906-c9d6-42c0-8387-d34b04eff810', 'c1963e33-a0f2-49f1-a225-b6163b9bf23a', 'dd8a41c0-3c37-4ad8-9b0e-f9af26469f97', '094b3e23-ae06-4409-b968-2d1e4fb9cb2d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:46 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:46 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-62f0bd66-49f6-4961-8d8e-0ce18841eb40-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-62f0bd66-49f6-4961-8d8e-0ce18841eb40-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-quobyte-62f0bd66-49f6-4961-8d8e-0ce18841eb40" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-62f0bd66-49f6-4961-8d8e-0ce18841eb40" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2956b1b5-19a7-406d-bb76-f4ca6edabc90]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:46 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 Jul 10 19:56:46 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:46 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c 1073741824" returned: 0 in 1.259s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:47 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:47 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (8de3b581-b665-48fd-a9f8-e547229d84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9ee0d3-5411-493f-a1ea-025c15e9eccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9ee0d3-5411-493f-a1ea-025c15e9eccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111775161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754042a4-7453-402a-92e6-baf586f3232a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:47Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2261cc0f-35ce-4224-9b4c-ef8561a3040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2261cc0f-35ce-4224-9b4c-ef8561a3040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9762a40b-ad5f-4ae3-8b79-ec29d7e017b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9762a40b-ad5f-4ae3-8b79-ec29d7e017b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '754042a4-7453-402a-92e6-baf586f3232a', 'volume_name': 'volume-754042a4-7453-402a-92e6-baf586f3232a', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32453113-3f0c-4026-85c9-837c6ba71e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32453113-3f0c-4026-85c9-837c6ba71e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9710d3a2-2bb7-4952-908a-72730a27f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume 754042a4-7453-402a-92e6-baf586f3232a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-754042a4-7453-402a-92e6-baf586f3232a', 'volume_size': 1} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:47 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.190s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Deleted volume successfully. Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-17e80ec8-a63d-49a8-accf-137f80a6ddc5 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-827568e0-dc67-483f-bb21-4bb4ef3acd80-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (2f12a8f5-4cc8-4184-810e-d2f3886a6818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42d7597-adfc-4b91-b9f2-1b06e512b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42d7597-adfc-4b91-b9f2-1b06e512b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1133355122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf47f132-4fdb-4f1d-a4be-5f86ce24c77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:48Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4712127c-34f9-493b-9988-8efeffc06ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4712127c-34f9-493b-9988-8efeffc06ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09b2643-dc3a-4b3f-b65c-43a2d586901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09b2643-dc3a-4b3f-b65c-43a2d586901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf47f132-4fdb-4f1d-a4be-5f86ce24c77e', 'volume_name': 'volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117522c0-e200-4425-a70e-92910b293402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117522c0-e200-4425-a70e-92910b293402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7760454e-d8f6-4881-875a-c99d1369d88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume cf47f132-4fdb-4f1d-a4be-5f86ce24c77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e', 'volume_size': 1} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:47 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40" returned: 0 in 1.276s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:48 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40 Jul 10 19:56:48 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:48 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 0 in 1.107s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111775161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754042a4-7453-402a-92e6-baf586f3232a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:47Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating volume 754042a4-7453-402a-92e6-baf586f3232a {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:48 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:48 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a 1073741824 Jul 10 19:56:48 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Attempting download of 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 ((None, [{'url': 'file:///opt/stack/data/glance/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'metadata': {}}])) to volume 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0d4a5-74cc-463b-9bd3-f16e32b1d7a2]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (25548149-0237-436d-8a51-800366435a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be94d12e-2945-40c0-b928-e736572b6a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be94d12e-2945-40c0-b928-e736572b6a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708846738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9c2ce8-b823-433c-9608-9bd76c2d3475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:48Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851c5346-a184-4dec-9feb-fdf71a9b87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:48 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851c5346-a184-4dec-9feb-fdf71a9b87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:48 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5ed719-6ee3-43a3-93f7-f91fc1f749fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5ed719-6ee3-43a3-93f7-f91fc1f749fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a9c2ce8-b823-433c-9608-9bd76c2d3475', 'volume_name': 'volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62b754e-1f05-4623-9bf0-9b449fe172d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62b754e-1f05-4623-9bf0-9b449fe172d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3d04a2-365a-4535-a849-2ea8eb15892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:48 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume 8a9c2ce8-b823-433c-9608-9bd76c2d3475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475', 'volume_size': 1} Jul 10 19:56:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (864a37b9-1d99-498c-b7c5-39db01f9bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c3283f-0732-44c1-bffe-884346500fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c3283f-0732-44c1-bffe-884346500fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444295308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6d9b86-072a-4e49-a443-f07f89e8051c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:49Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a1fb79-5f0d-457c-8ada-a0a00e5dfa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a1fb79-5f0d-457c-8ada-a0a00e5dfa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7167e875-d35f-4ecc-a1c8-3fdaae66152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7167e875-d35f-4ecc-a1c8-3fdaae66152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6d9b86-072a-4e49-a443-f07f89e8051c', 'volume_name': 'volume-6f6d9b86-072a-4e49-a443-f07f89e8051c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5bd6c9-2d25-42e4-b95b-02fc2143e2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5bd6c9-2d25-42e4-b95b-02fc2143e2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0eb7e1-bc15-494c-8a03-d78dba9cab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume 6f6d9b86-072a-4e49-a443-f07f89e8051c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6d9b86-072a-4e49-a443-f07f89e8051c', 'volume_size': 1} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-62f0bd66-49f6-4961-8d8e-0ce18841eb40" returned: 0 in 1.405s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-62f0bd66-49f6-4961-8d8e-0ce18841eb40" released by "delete_volume" :: held 2.733s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (4bafbb14-c637-4caf-a544-1dc1f5cfe106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6026e073-9b04-42ea-80ca-663d90f99eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6026e073-9b04-42ea-80ca-663d90f99eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-180632104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769ac0ce-0240-4fdc-9113-c2792c4159a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:49Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78194242-5c40-4d1a-9b53-3d4fbfa5c927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78194242-5c40-4d1a-9b53-3d4fbfa5c927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d715c5c0-cf4b-4561-a06f-1803a1a0ed7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d715c5c0-cf4b-4561-a06f-1803a1a0ed7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769ac0ce-0240-4fdc-9113-c2792c4159a0', 'volume_name': 'volume-769ac0ce-0240-4fdc-9113-c2792c4159a0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7054228e-c732-438c-a8fc-beca3027df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7054228e-c732-438c-a8fc-beca3027df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63f9439-2053-4989-a2d1-a733e92a3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume 769ac0ce-0240-4fdc-9113-c2792c4159a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769ac0ce-0240-4fdc-9113-c2792c4159a0', 'volume_size': 1} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m" returned: 0 in 1.196s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created reservations ['dec5c25d-5c76-40d4-9925-ba2a3e817a55', '21b92b4b-1705-4243-8856-fa52e752d7e0', 'cc21dc1e-dcca-486e-9db6-21ea4e59b4f2', '49f3b429-d9f2-44f8-a5ea-116e10c12195'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:49 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a 1073741824" returned: 0 in 1.484s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:49 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m Jul 10 19:56:49 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:49 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a Jul 10 19:56:49 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:49 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:49 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Flow 'volume_create_manager' (50d712e6-09ec-4e7c-b692-a0fe1d5f7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b06e30f-21e9-44c1-a6d1-0134cd277660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b06e30f-21e9-44c1-a6d1-0134cd277660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253881559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1da363b-798c-4c32-9b83-44f627062237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2476daa4b01456b93b34bd3ce2091f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:50Z,use_quota=True,user_id='d4f906caa03040ad984275d8f70e3582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549b277-4d34-4e50-a531-fc0cad8d3e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:49 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549b277-4d34-4e50-a531-fc0cad8d3e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088d6de4-6c31-43f8-8df4-a55e701f8e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088d6de4-6c31-43f8-8df4-a55e701f8e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1da363b-798c-4c32-9b83-44f627062237', 'volume_name': 'volume-b1da363b-798c-4c32-9b83-44f627062237', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a023297-7454-4f41-adff-f2c9dca5fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a023297-7454-4f41-adff-f2c9dca5fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34f7c57-9c53-4a38-bd2a-545fb69df990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:50 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Volume b1da363b-798c-4c32-9b83-44f627062237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1da363b-798c-4c32-9b83-44f627062237', 'volume_size': 1} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-a44065f7-d5e3-4b96-babe-4da2d77ec93d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-a44065f7-d5e3-4b96-babe-4da2d77ec93d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-quobyte-a44065f7-d5e3-4b96-babe-4da2d77ec93d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-a44065f7-d5e3-4b96-babe-4da2d77ec93d" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9693f2b6-0e73-4639-9465-8d9bcc7f8b83]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:50 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d Jul 10 19:56:50 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:50 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m" returned: 1 in 0.879s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_gfg5rz8m' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[14293ab1-c200-4b6f-8425-faedf8c32881]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:50 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD Jul 10 19:56:50 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:50 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a" returned: 0 in 0.898s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1133355122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf47f132-4fdb-4f1d-a4be-5f86ce24c77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:48Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating volume cf47f132-4fdb-4f1d-a4be-5f86ce24c77e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:50 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:50 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.908s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Deleted volume successfully. Jul 10 19:56:50 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e 1073741824 Jul 10 19:56:50 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9710d3a2-2bb7-4952-908a-72730a27f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-754042a4-7453-402a-92e6-baf586f3232a', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cd7518-2c4f-4871-8292-95d2819102a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:50 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume volume-754042a4-7453-402a-92e6-baf586f3232a (754042a4-7453-402a-92e6-baf586f3232a): created successfully Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cd7518-2c4f-4871-8292-95d2819102a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (8de3b581-b665-48fd-a9f8-e547229d84b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d00cd2c-86b5-4dfc-9c54-59a447ab3187 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-62f0bd66-49f6-4961-8d8e-0ce18841eb40-delete_volume" released by "delete_volume" :: held 4.135s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d1f3172b-1f06-4b1a-ad7d-e97e764573f3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created volume successfully. Jul 10 19:56:51 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d" returned: 0 in 0.844s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:51 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d Jul 10 19:56:51 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:51 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:51 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD Jul 10 19:56:51 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:51 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e 1073741824" returned: 0 in 0.977s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:51 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e Jul 10 19:56:51 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:51 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a44065f7-d5e3-4b96-babe-4da2d77ec93d" returned: 0 in 0.732s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-a44065f7-d5e3-4b96-babe-4da2d77ec93d" released by "delete_volume" :: held 1.621s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created reservations ['2a929e81-1c14-411a-8453-8ef0e8986f51', '571ecd9b-9e46-4084-ab25-92a0bcbec989', 'e961a931-f1f9-43d0-8ab9-1766e43fd39a', 'a2e8fc03-8fdf-4195-9aa8-558302104b4a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:51 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:51 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:52 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 was raw, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:52 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:52 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:52 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e" returned: 0 in 0.696s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.681s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708846738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9c2ce8-b823-433c-9608-9bd76c2d3475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:48Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating volume 8a9c2ce8-b823-433c-9608-9bd76c2d3475 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:52 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-8dded584-22cb-4d68-a70a-b81b496a42db-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:52 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 1073741824 Jul 10 19:56:52 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7760454e-d8f6-4881-875a-c99d1369d88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39db5d24-0750-4353-ba25-1e1b1bef4055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-8dded584-22cb-4d68-a70a-b81b496a42db-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e (cf47f132-4fdb-4f1d-a4be-5f86ce24c77e): created successfully Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39db5d24-0750-4353-ba25-1e1b1bef4055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (2f12a8f5-4cc8-4184-810e-d2f3886a6818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e6ab49ce-59b8-409b-aecf-ef8dbf2997ec tempest-CreateVolumesFromSnapshotTest-694320618 None] Created volume successfully. Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-quobyte-8dded584-22cb-4d68-a70a-b81b496a42db" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-8dded584-22cb-4d68-a70a-b81b496a42db" acquired by "delete_volume" :: waited 0.033s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[84611681-cfa3-4003-92c7-d40f89d9f39f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:52 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db Jul 10 19:56:52 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:52 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Deleted volume successfully. Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0f984f91-3fd3-445d-8372-7484f547581c tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-a44065f7-d5e3-4b96-babe-4da2d77ec93d-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:52 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 0 in 0.824s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5319fd63-8d9c-4ca4-b6fa-c9984b0bd633_9k4ukzufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:56:52 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 19:56:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:52 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c 1G Jul 10 19:56:52 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:53 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db" returned: 0 in 0.825s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:53 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db Jul 10 19:56:53 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:53 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 1073741824" returned: 0 in 1.112s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:53 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 Jul 10 19:56:53 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:53 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c 1G" returned: 0 in 0.804s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e790d2-d379-453f-b529-b0badb4189f7]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:53 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:53 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:54 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8dded584-22cb-4d68-a70a-b81b496a42db" returned: 0 in 0.716s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-8dded584-22cb-4d68-a70a-b81b496a42db" released by "delete_volume" :: held 1.593s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created reservations ['c8b62bef-3483-439a-8830-d77019d54111', '3f502210-6391-4f15-bb7f-c1db2102c008', 'e476cb99-77a0-45dc-9d47-7339b02b7809', '665c7bf7-9435-44c1-a63c-f88f0d5236d8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:54 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475" returned: 0 in 0.733s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.839s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444295308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6d9b86-072a-4e49-a443-f07f89e8051c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:49Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating volume 6f6d9b86-072a-4e49-a443-f07f89e8051c {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:54 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:54 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c 1073741824 Jul 10 19:56:54 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3d04a2-365a-4535-a849-2ea8eb15892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e211b3-a323-4e8d-bc09-a41cc37928e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 (8a9c2ce8-b823-433c-9608-9bd76c2d3475): created successfully Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e211b3-a323-4e8d-bc09-a41cc37928e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (25548149-0237-436d-8a51-800366435a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7fbc33b9-4a4a-49da-b7f5-21e00292ffbc tempest-CreateVolumesFromSnapshotTest-694320618 None] Created volume successfully. Jul 10 19:56:54 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:54 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:54 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 0 in 0.848s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-c112b4d6-81e0-4a37-aad2-ce63936e5838-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-c112b4d6-81e0-4a37-aad2-ce63936e5838-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "cinder-quobyte-c112b4d6-81e0-4a37-aad2-ce63936e5838" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:54 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:54 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-c112b4d6-81e0-4a37-aad2-ce63936e5838" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[374f4317-aeed-462a-af13-fbc3831641fd]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:55 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 Jul 10 19:56:55 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:55 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.779s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:55 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Deleted volume successfully. Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-756c8354-2b30-4602-9cb6-44cee5433887 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-8dded584-22cb-4d68-a70a-b81b496a42db-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:55 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c 1073741824" returned: 0 in 1.016s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:55 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c Jul 10 19:56:55 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:55 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 1 in 0.917s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Downloaded image 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 ((None, [{'url': 'file:///opt/stack/data/glance/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'metadata': {}}])) to volume 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Temporary image 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 for user 4d8dfbbf9a9b4a6d90b3a0863c732b13 is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Marking volume 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Copying metadata from image 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 to 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Creating volume glance metadata for volume 4a20171d-9c55-4cac-ba8d-98e30e7a6e5c backed by image 5319fd63-8d9c-4ca4-b6fa-c9984b0bd633 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '180c2a051cdf5136f201bba107fc5e7d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a075365b-2398-401b-ac85-284b4f1743fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c', 'volume_size': 1, 'image_id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '180c2a051cdf5136f201bba107fc5e7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e28c7e5c61e1445f9f2fa7d2b2b03b58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '130744119f6ac590c8d449785d09848eed0a9da40f9828af48a9160ab88324e3b2b9ddc2c260c99f4a5c8bf7c6fdceeca2cc2c32988d345583a4c1d2caa47241', 'id': '5319fd63-8d9c-4ca4-b6fa-c9984b0bd633', 'created_at': datetime.datetime(2026, 7, 10, 17, 56, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5319fd63-8d9c-4ca4-b6fa-c9984b0bd633/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e6270b-255a-4b28-b577-296e7df9e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:55 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Volume volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c (4a20171d-9c55-4cac-ba8d-98e30e7a6e5c): created successfully Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e6270b-255a-4b28-b577-296e7df9e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Flow 'volume_create_manager' (9d52316f-1be3-4d11-92b2-a280078e6c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:55 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-79715a2e-21cc-486b-bde5-fd9f5f016d74 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Created volume successfully. Jul 10 19:56:55 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838" returned: 0 in 0.868s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:55 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838 Jul 10 19:56:55 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Acquiring lock "cinder-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "cinder-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Acquiring lock "cinder-quobyte-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "cinder-quobyte-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb6ac5-ba9b-4c08-b635-09a1247445ab]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:56 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c" returned: 0 in 0.769s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.494s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-180632104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769ac0ce-0240-4fdc-9113-c2792c4159a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2016892282ec4a679ae8ed7298ff40d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:49Z,use_quota=True,user_id='a4c1dda344414ec9bda4bd2dd74662e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Creating volume 769ac0ce-0240-4fdc-9113-c2792c4159a0 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:56 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0eb7e1-bc15-494c-8a03-d78dba9cab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6d9b86-072a-4e49-a443-f07f89e8051c', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:56 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 1073741824 Jul 10 19:56:56 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bf1fa8-f95b-4a2b-9987-6b3b0480891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:56 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume volume-6f6d9b86-072a-4e49-a443-f07f89e8051c (6f6d9b86-072a-4e49-a443-f07f89e8051c): created successfully Jul 10 19:56:56 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:56 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bf1fa8-f95b-4a2b-9987-6b3b0480891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (864a37b9-1d99-498c-b7c5-39db01f9bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:56 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9a2f839f-c13c-42d5-a5bd-4873efe576a3 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created volume successfully. Jul 10 19:56:56 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c112b4d6-81e0-4a37-aad2-ce63936e5838" returned: 0 in 0.780s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-quobyte-c112b4d6-81e0-4a37-aad2-ce63936e5838" released by "delete_volume" :: held 1.698s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Created reservations ['13bf610e-ca2e-477e-8d78-4f5d978c6e79', '0d961d35-74b6-4427-8ab1-8895260104f4', '8865fd57-2642-419b-904c-63f00a9d0cff', '93c2bcda-9c4b-4170-bfe6-8d4a017ac3dd'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:56 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:56 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:56 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 0 in 0.831s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:56 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 1073741824" returned: 0 in 0.941s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:57 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:57 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:57 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 Jul 10 19:56:57 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:57 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.844s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:56:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Deleted volume successfully. Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-94a078da-e219-4aac-a741-1a57af9b8584 tempest-CreateVolumesFromSourceVolumeTest-1738166641 None] Lock "cinder-c112b4d6-81e0-4a37-aad2-ce63936e5838-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:57 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0" returned: 0 in 0.755s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.794s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253881559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1da363b-798c-4c32-9b83-44f627062237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2476daa4b01456b93b34bd3ce2091f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:56:50Z,use_quota=True,user_id='d4f906caa03040ad984275d8f70e3582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Creating volume b1da363b-798c-4c32-9b83-44f627062237 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:56:57 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:57 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 1 in 1.041s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:57 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 1073741824 Jul 10 19:56:57 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63f9439-2053-4989-a2d1-a733e92a3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769ac0ce-0240-4fdc-9113-c2792c4159a0', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e3a1ac-92ae-4cf1-8cf2-6785abef1cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:57 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c Jul 10 19:56:57 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:57 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Volume volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 (769ac0ce-0240-4fdc-9113-c2792c4159a0): created successfully Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e3a1ac-92ae-4cf1-8cf2-6785abef1cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:57 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Flow 'volume_create_manager' (4bafbb14-c637-4caf-a544-1dc1f5cfe106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d41c2c3f-eeb0-40f2-a5c8-f99e67299717 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created volume successfully. Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-769ac0ce-0240-4fdc-9113-c2792c4159a0-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-769ac0ce-0240-4fdc-9113-c2792c4159a0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-769ac0ce-0240-4fdc-9113-c2792c4159a0" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-769ac0ce-0240-4fdc-9113-c2792c4159a0" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7527baf-2262-4b63-a9cb-347841b57bc6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:58 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 Jul 10 19:56:58 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:58 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" returned: 0 in 0.897s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "cinder-quobyte-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c" released by "delete_volume" :: held 2.853s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Created reservations ['47c41f8d-088c-4a23-8232-b234a72b8d27', '45208bf7-60de-4a7d-bd24-7a463edfe32b', '2fa6e660-e619-4139-8f84-b286fac69280', '2c6cd3ff-67ee-4448-9e92-a53a2735c500'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:56:58 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 1073741824" returned: 0 in 1.026s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:56:58 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 Jul 10 19:56:58 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:59 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:56:59 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:59 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0" returned: 0 in 1.074s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:56:59 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0 Jul 10 19:56:59 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:56:59 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237" returned: 0 in 0.979s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34f7c57-9c53-4a38-bd2a-545fb69df990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1da363b-798c-4c32-9b83-44f627062237', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7725529b-85fa-46fa-b600-a32c0cfd22bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:56:59 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Volume volume-b1da363b-798c-4c32-9b83-44f627062237 (b1da363b-798c-4c32-9b83-44f627062237): created successfully Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7725529b-85fa-46fa-b600-a32c0cfd22bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:56:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Flow 'volume_create_manager' (50d712e6-09ec-4e7c-b692-a0fe1d5f7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:56:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7df7c351-979d-4ca0-ad10-3d9ff39c7e6a tempest-ProjectReaderTests-317203649 None] Created volume successfully. Jul 10 19:57:00 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.110s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:00 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Deleted volume successfully. Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-98c898de-8faa-4654-9da5-5201055b19e5 tempest-VolumeAndVolumeTypeFromImageTest-1066614812 None] Lock "cinder-4a20171d-9c55-4cac-ba8d-98e30e7a6e5c-delete_volume" released by "delete_volume" :: held 4.246s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:00 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-769ac0ce-0240-4fdc-9113-c2792c4159a0" returned: 0 in 0.880s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-769ac0ce-0240-4fdc-9113-c2792c4159a0" released by "delete_volume" :: held 2.012s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['249b0ff2-8a25-477b-a4a4-0ea23806c714', 'bdf397bd-dc15-4531-9d77-1a0de1e61208', '1c31d14f-711a-4e09-9842-892b4cd6936c', 'ff562d26-2d19-48c7-a064-cc660a3bbe99'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:00 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:00 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Flow 'volume_create_manager' (bf5d4a18-cfee-4185-859d-1796e8f3a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cccb51d-fe61-4dc2-abac-64b6dffe3f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-6f6d9b86-072a-4e49-a443-f07f89e8051c-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cccb51d-fe61-4dc2-abac-64b6dffe3f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52d1f0a-4bca-4328-8b28-505942eb4a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f837a4ddff4b3398241b921273f07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:01Z,use_quota=True,user_id='31461fbd6ede4b73bb4abfc5d027b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f17970a-2a50-4ae0-8971-21ff4474e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f17970a-2a50-4ae0-8971-21ff4474e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30c1b2a-34f0-48a4-bcd6-7a004f5c37a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30c1b2a-34f0-48a4-bcd6-7a004f5c37a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52d1f0a-4bca-4328-8b28-505942eb4a91', 'volume_name': 'volume-e52d1f0a-4bca-4328-8b28-505942eb4a91', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9adbb6-2f80-4da4-9f05-99a00a0db23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9adbb6-2f80-4da4-9f05-99a00a0db23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a724103f-6dc7-40b2-aed0-bd4bdb2539e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Volume e52d1f0a-4bca-4328-8b28-505942eb4a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52d1f0a-4bca-4328-8b28-505942eb4a91', 'volume_size': 1} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52d1f0a-4bca-4328-8b28-505942eb4a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f837a4ddff4b3398241b921273f07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:01Z,use_quota=True,user_id='31461fbd6ede4b73bb4abfc5d027b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Creating volume e52d1f0a-4bca-4328-8b28-505942eb4a91 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:00 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-6f6d9b86-072a-4e49-a443-f07f89e8051c-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:00 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 1073741824 Jul 10 19:57:00 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-6f6d9b86-072a-4e49-a443-f07f89e8051c" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-6f6d9b86-072a-4e49-a443-f07f89e8051c" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13a32e-a684-4f2d-a513-4f2c1ededfb8]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Acquiring lock "cinder-b1da363b-798c-4c32-9b83-44f627062237-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Lock "cinder-b1da363b-798c-4c32-9b83-44f627062237-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:01 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c Jul 10 19:57:01 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Acquiring lock "cinder-quobyte-b1da363b-798c-4c32-9b83-44f627062237" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Lock "cinder-quobyte-b1da363b-798c-4c32-9b83-44f627062237" acquired by "delete_volume" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1b1574-eeb2-476e-8866-cf47a3bc61b7]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:01 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 Jul 10 19:57:01 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:01 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.036s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleted volume successfully. Jul 10 19:57:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-243d47ef-cb7c-44d4-bcea-fd8564a8a048 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-769ac0ce-0240-4fdc-9113-c2792c4159a0-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:02 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c" returned: 0 in 0.976s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:02 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c Jul 10 19:57:02 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:02 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 1073741824" returned: 0 in 1.396s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:02 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 Jul 10 19:57:02 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:02 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237" returned: 0 in 1.198s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:02 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237 Jul 10 19:57:02 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:02 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-6f6d9b86-072a-4e49-a443-f07f89e8051c" returned: 0 in 0.800s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-6f6d9b86-072a-4e49-a443-f07f89e8051c" released by "delete_volume" :: held 1.841s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:02 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['f7483b6c-713e-4d51-8c67-4d4592404d0d', 'e07188d8-963d-4641-b8a6-6778941c38b3', 'bcc14083-05e0-45fb-8ac0-f74b2be453f8', '949c6390-025f-458a-9ace-a6a79802edc4'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:03 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:03 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-8a9c2ce8-b823-433c-9608-9bd76c2d3475-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-8a9c2ce8-b823-433c-9608-9bd76c2d3475-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:03 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91" returned: 0 in 0.938s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-8a9c2ce8-b823-433c-9608-9bd76c2d3475" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a724103f-6dc7-40b2-aed0-bd4bdb2539e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52d1f0a-4bca-4328-8b28-505942eb4a91', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b1c778-416e-45c9-96da-a755e74438d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-8a9c2ce8-b823-433c-9608-9bd76c2d3475" acquired by "delete_volume" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:03 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Volume volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 (e52d1f0a-4bca-4328-8b28-505942eb4a91): created successfully Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b1c778-416e-45c9-96da-a755e74438d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Flow 'volume_create_manager' (bf5d4a18-cfee-4185-859d-1796e8f3a541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b91d19-726c-471a-88ad-797b871dde68]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:03 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b67b0973-531b-4f88-a57f-fe17461c194c tempest-CinderUnicodeTest-1335976171 None] Created volume successfully. Jul 10 19:57:03 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 Jul 10 19:57:03 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:03 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b1da363b-798c-4c32-9b83-44f627062237" returned: 0 in 1.006s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Lock "cinder-quobyte-b1da363b-798c-4c32-9b83-44f627062237" released by "delete_volume" :: held 2.269s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Created reservations ['061e417b-87a6-43b5-898c-5f6491958c28', '1ceb4c32-3a33-4ba4-952b-52da105f6b8f', '6343e202-5aa7-4f51-afbc-b9f6b1f704c4', '4ca09fa7-faa5-4c74-a755-03496a0e22a9'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:03 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:03 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:03 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.908s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleted volume successfully. Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-18835f8b-5047-42a1-af09-e0ffdc7e407a tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-6f6d9b86-072a-4e49-a443-f07f89e8051c-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:04 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475" returned: 0 in 1.120s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:04 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475 Jul 10 19:57:04 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Flow 'volume_create_manager' (609ae148-5bd9-4507-960e-72a4a8b07d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de025ce6-da01-4320-ab7c-8af4d0558eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de025ce6-da01-4320-ab7c-8af4d0558eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-967220945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd2b37-81fd-4102-bd3a-3e7fd242ac9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f837a4ddff4b3398241b921273f07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:05Z,use_quota=True,user_id='31461fbd6ede4b73bb4abfc5d027b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247f4f3c-0aa2-48c1-b929-8d6ca235ba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247f4f3c-0aa2-48c1-b929-8d6ca235ba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4394f48-f872-42c8-ae03-f90e1cf6bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4394f48-f872-42c8-ae03-f90e1cf6bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dd2b37-81fd-4102-bd3a-3e7fd242ac9f', 'volume_name': 'volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:04 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5c337d-da36-4cab-915a-b853c83a651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5c337d-da36-4cab-915a-b853c83a651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3b881c-0161-476e-873a-e2876de1e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Volume 36dd2b37-81fd-4102-bd3a-3e7fd242ac9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f', 'volume_size': 1} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-967220945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd2b37-81fd-4102-bd3a-3e7fd242ac9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f837a4ddff4b3398241b921273f07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:05Z,use_quota=True,user_id='31461fbd6ede4b73bb4abfc5d027b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Creating volume 36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:04 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.057s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Deleted volume successfully. Jul 10 19:57:04 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f 1073741824 Jul 10 19:57:04 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d825113f-5185-4c20-96d4-af1d66eab9f7 tempest-ProjectReaderTests-317203649 None] Lock "cinder-b1da363b-798c-4c32-9b83-44f627062237-delete_volume" released by "delete_volume" :: held 3.700s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Flow 'volume_create_manager' (327fbb19-d3d2-4bd9-96fb-5c49a9c42aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384195a5-acfb-4b83-9e50-bf173b5098f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384195a5-acfb-4b83-9e50-bf173b5098f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144830354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad420bbc-1dcf-4f20-946a-a3d360ffdd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2476daa4b01456b93b34bd3ce2091f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:05Z,use_quota=True,user_id='d4f906caa03040ad984275d8f70e3582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc61d5f-7849-4ec5-b411-8cae9018a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc61d5f-7849-4ec5-b411-8cae9018a763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c497ed2-f51a-4063-a45a-7b8b804c821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c497ed2-f51a-4063-a45a-7b8b804c821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad420bbc-1dcf-4f20-946a-a3d360ffdd4f', 'volume_name': 'volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de9ac3-9009-4b4a-b9ca-10329ee37604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de9ac3-9009-4b4a-b9ca-10329ee37604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3570a69-9fd9-4a66-8ad2-002969bbee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Volume ad420bbc-1dcf-4f20-946a-a3d360ffdd4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f', 'volume_size': 1} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:05 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8a9c2ce8-b823-433c-9608-9bd76c2d3475" returned: 0 in 0.885s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-8a9c2ce8-b823-433c-9608-9bd76c2d3475" released by "delete_volume" :: held 2.092s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['a2823280-ca1b-4d83-be6a-c84a4739654b', 'cf0c3559-c7ab-4036-b5d0-497b44ed04d0', '365fd2dd-80d1-472c-b63a-ec46638bdbee', '68504453-04fa-47db-a432-e0de80ee5814'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:05 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:05 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Flow 'volume_create_manager' (9b01cdf8-c73a-40d2-bdeb-aacfffc03be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdd4583-d805-4296-b8b0-898447133588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdd4583-d805-4296-b8b0-898447133588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-105725311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c44f4-ad2d-4703-8934-d796ee566c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5995f156163942a2bbbb9c66e772b576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:06Z,use_quota=True,user_id='21e75e0ccd2c425a865efd5c81dcc2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1665f8f1-c11d-490a-9be3-9a3b76af5ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1665f8f1-c11d-490a-9be3-9a3b76af5ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40500b8-818c-4391-9d56-4714e9ef2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40500b8-818c-4391-9d56-4714e9ef2650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08c44f4-ad2d-4703-8934-d796ee566c8e', 'volume_name': 'volume-d08c44f4-ad2d-4703-8934-d796ee566c8e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5dd029e-5904-4f26-a321-4ae6ceb585e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5dd029e-5904-4f26-a321-4ae6ceb585e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083ba323-e004-463d-ba4a-7f2321711a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Volume d08c44f4-ad2d-4703-8934-d796ee566c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08c44f4-ad2d-4703-8934-d796ee566c8e', 'volume_size': 1} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:05 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f 1073741824" returned: 0 in 1.112s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:06 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f Jul 10 19:57:06 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:06 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.723s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleted volume successfully. Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6ca425c4-91f5-4b7e-a26e-e753cbb27525 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-8a9c2ce8-b823-433c-9608-9bd76c2d3475-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:06 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144830354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad420bbc-1dcf-4f20-946a-a3d360ffdd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2476daa4b01456b93b34bd3ce2091f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:05Z,use_quota=True,user_id='d4f906caa03040ad984275d8f70e3582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Creating volume ad420bbc-1dcf-4f20-946a-a3d360ffdd4f {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:06 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3b881c-0161-476e-873a-e2876de1e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:06 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f 1073741824 Jul 10 19:57:06 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edbb478-1569-40f9-85d5-ecc4c04ab874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:06 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Volume volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f (36dd2b37-81fd-4102-bd3a-3e7fd242ac9f): created successfully Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edbb478-1569-40f9-85d5-ecc4c04ab874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Flow 'volume_create_manager' (609ae148-5bd9-4507-960e-72a4a8b07d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2462f3a6-d2af-4c92-8c27-d347174656c5 tempest-CinderUnicodeTest-1335976171 None] Created volume successfully. Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dd5483-58a9-4d2b-b1cc-7f31c7a66991]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:06 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e Jul 10 19:57:06 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:07 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f 1073741824" returned: 0 in 0.856s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:07 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e" returned: 0 in 0.803s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:07 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f Jul 10 19:57:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:07 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:07 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e Jul 10 19:57:07 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:08 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f" returned: 0 in 0.727s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.517s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-105725311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c44f4-ad2d-4703-8934-d796ee566c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5995f156163942a2bbbb9c66e772b576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:06Z,use_quota=True,user_id='21e75e0ccd2c425a865efd5c81dcc2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Creating volume d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:08 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:08 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e" returned: 0 in 0.725s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:08 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e 1073741824 Jul 10 19:57:08 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3570a69-9fd9-4a66-8ad2-002969bbee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bc2788-1ca4-40e4-899f-a54f4dcfd231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e" released by "delete_volume" :: held 1.604s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:08 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Volume volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f (ad420bbc-1dcf-4f20-946a-a3d360ffdd4f): created successfully Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bc2788-1ca4-40e4-899f-a54f4dcfd231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Flow 'volume_create_manager' (327fbb19-d3d2-4bd9-96fb-5c49a9c42aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:08 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f998da0e-7848-415f-86c9-8d96ba3c2cce tempest-ProjectReaderTests-317203649 None] Created volume successfully. Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['01b188b0-93d4-402b-a22d-044a63fa8e9b', 'a6a190ed-ff4f-4390-b109-41113733ed20', '76d47784-9816-4d43-bfcd-e5137b5d18e0', 'b295c2a8-3442-41a7-baa1-0df558ad6eb1'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:08 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:08 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-754042a4-7453-402a-92e6-baf586f3232a-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-754042a4-7453-402a-92e6-baf586f3232a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-754042a4-7453-402a-92e6-baf586f3232a" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-754042a4-7453-402a-92e6-baf586f3232a" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bdb49-1186-499d-a313-eef5573f0ca7]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:09 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a Jul 10 19:57:09 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:09 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.705s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleted volume successfully. Jul 10 19:57:09 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e 1073741824" returned: 0 in 0.896s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a73f7638-b2a9-4e76-b273-bc24a6f6e6e4 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-cf47f132-4fdb-4f1d-a4be-5f86ce24c77e-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:09 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:09 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Acquiring lock "cinder-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Lock "cinder-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Acquiring lock "cinder-quobyte-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Lock "cinder-quobyte-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833720c-66f9-410c-871b-8aafae3c29aa]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:09 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f Jul 10 19:57:09 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:09 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:09 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a Jul 10 19:57:09 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:09 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.939s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083ba323-e004-463d-ba4a-7f2321711a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08c44f4-ad2d-4703-8934-d796ee566c8e', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8944576-4dc7-4e84-9cdb-1888debdd51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Creating offline snapshot b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 of volume 36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:57:10 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Volume volume-d08c44f4-ad2d-4703-8934-d796ee566c8e (d08c44f4-ad2d-4703-8934-d796ee566c8e): created successfully Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8944576-4dc7-4e84-9cdb-1888debdd51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Flow 'volume_create_manager' (9b01cdf8-c73a-40d2-bdeb-aacfffc03be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94bd906-aa44-4b5a-8ac7-717a4978210a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-763c2a1f-a5df-40e8-bc14-a9ea7da7cd1a tempest-VolumeDependencyTests-760904881 None] Created volume successfully. Jul 10 19:57:10 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f Jul 10 19:57:10 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:10 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f" returned: 0 in 0.833s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:10 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f Jul 10 19:57:10 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:10 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-754042a4-7453-402a-92e6-baf586f3232a" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-754042a4-7453-402a-92e6-baf586f3232a" released by "delete_volume" :: held 1.595s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['9ed0edc7-72c3-4b36-86b8-5dd89224daf5', '57c71a14-6106-49d0-97ee-81fe5684c955', '44dfc7cd-4ef8-46d1-abf4-d0463b44de6c', 'be1f2132-bbc5-4953-87a3-4bd05e9f2c02'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:10 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:10 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:10 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" returned: 0 in 0.863s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:10 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 1G Jul 10 19:57:10 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:11 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f" returned: 0 in 0.684s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Lock "cinder-quobyte-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f" released by "delete_volume" :: held 1.572s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-58e01601-3a84-468f-b6fa-223d807494f5-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-58e01601-3a84-468f-b6fa-223d807494f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-07bcde7d-b307-47d5-bf81-d7f4abaa889e" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Created reservations ['c472fc2d-ea3b-4c95-8df4-97914709c2a3', '243398f7-0562-4706-86c3-44f2e5af1252', '0074e7d7-ecc5-423e-8c2c-ddb108874367', '54da0158-86c3-4ec0-93bd-1be8a935b5d7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-07bcde7d-b307-47d5-bf81-d7f4abaa889e" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-58e01601-3a84-468f-b6fa-223d807494f5" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-58e01601-3a84-468f-b6fa-223d807494f5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleting offline snapshot 58e01601-3a84-468f-b6fa-223d807494f5 of volume 07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] snapshot_file for this snap is: volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b0a82-63c8-4b08-95f5-0d85ad5e4805]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:11 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:11 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:11 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 Jul 10 19:57:11 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:11 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:11 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleted volume successfully. Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1ed5cb47-e56d-471c-8ed3-f62bffaa4bc5 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-754042a4-7453-402a-92e6-baf586f3232a-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:11 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 1G" returned: 0 in 1.019s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:11 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 Jul 10 19:57:11 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:12 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.818s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:12 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Deleted volume successfully. Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-3cb03e8d-8d26-4603-9b5c-75b8d6c2ac78 tempest-ProjectReaderTests-317203649 None] Lock "cinder-ad420bbc-1dcf-4f20-946a-a3d360ffdd4f-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:12 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5" returned: 0 in 0.990s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb21a60-25f4-4e75-9281-da273a44ee2c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:12 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e Jul 10 19:57:12 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:12 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" returned: 0 in 0.849s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:12 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 is being set with open permissions: ugo+rw Jul 10 19:57:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:12 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 Jul 10 19:57:12 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:13 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e" returned: 0 in 0.888s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:13 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 Jul 10 19:57:13 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:13 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" returned: 0 in 0.739s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:13 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info Jul 10 19:57:13 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:14 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5" returned: 0 in 0.790s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:14 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5 Jul 10 19:57:14 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:14 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:14 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info is being set with open permissions: ugo+rw Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:14 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info Jul 10 19:57:14 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:14 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e.58e01601-3a84-468f-b6fa-223d807494f5" returned: 0 in 0.691s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=154,cinder:UPDATE=239,cinder:INSERT=52,cinder:DELETE=21 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=213,cinder:SELECT=157,cinder:INSERT=59,cinder:DELETE=22 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-58e01601-3a84-468f-b6fa-223d807494f5" released by "_delete_snapshot" :: held 3.504s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-07bcde7d-b307-47d5-bf81-d7f4abaa889e" released by "delete_snapshot" :: held 3.548s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['bf8e7df0-68cd-4464-89b3-b26ede1ac568', '2e7ee131-a208-4736-8ded-e4789e5e83d8', 'f43d532a-d9b0-44e5-9242-b4c24baa6322', '78d97b78-a784-4224-9654-7977845ab31c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:14 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.info" returned: 0 in 0.717s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.029s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.580s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Delete snapshot completed successfully. Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c965596-5f85-4222-8cc4-06d86735fce7 tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-58e01601-3a84-468f-b6fa-223d807494f5-delete_snapshot" released by "delete_snapshot" :: held 3.807s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:15 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ef312d6e-c35c-4ffe-a899-69318925b127 tempest-CinderUnicodeTest-1335976171 None] Create snapshot completed successfully Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Creating offline snapshot 283667c9-2bdd-46a8-81de-bf0e1a170d66 of volume d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f620a3f5-247e-45d3-9574-77821026c4f9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:15 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:15 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-quobyte-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-quobyte-b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Deleting offline snapshot b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 of volume 36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] snapshot_file for this snap is: volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-07bcde7d-b307-47d5-bf81-d7f4abaa889e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a736f7-2146-417a-9318-ab9e4625ba84]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-07bcde7d-b307-47d5-bf81-d7f4abaa889e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "cinder-quobyte-07bcde7d-b307-47d5-bf81-d7f4abaa889e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-07bcde7d-b307-47d5-bf81-d7f4abaa889e" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:15 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 Jul 10 19:57:15 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a278f1b2-dc37-4f2e-bbef-162cac217673]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (af9d650f-e06c-4cdd-809d-17f4925b9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5e4bb8-b120-4c5d-95b6-8926ab12b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5e4bb8-b120-4c5d-95b6-8926ab12b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313958902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb73ba0-c1a7-4913-8834-a88a14e16662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:16Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f3135c-2cd5-4b7e-87f3-73115991ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f3135c-2cd5-4b7e-87f3-73115991ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21e181e-d73b-446b-9d38-63137979bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21e181e-d73b-446b-9d38-63137979bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb73ba0-c1a7-4913-8834-a88a14e16662', 'volume_name': 'volume-1cb73ba0-c1a7-4913-8834-a88a14e16662', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:15 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e Jul 10 19:57:15 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4095fdae-ba76-4829-a345-29b44a475639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4095fdae-ba76-4829-a345-29b44a475639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837c874c-bb3e-40a5-97dc-a37663e60c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:15 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Volume 1cb73ba0-c1a7-4913-8834-a88a14e16662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb73ba0-c1a7-4913-8834-a88a14e16662', 'volume_size': 1} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:15 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 0.880s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:16 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 1G Jul 10 19:57:16 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:16 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" returned: 0 in 0.841s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbca27e8-c775-4b00-a3f0-6f3880e8053f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:16 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e" returned: 0 in 0.811s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:16 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f Jul 10 19:57:16 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e Jul 10 19:57:16 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:16 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:16 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 1G" returned: 0 in 0.900s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08c44f4-ad2d-4703-8934-d796ee566c8e -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:16 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08c44f4-ad2d-4703-8934-d796ee566c8e -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 Jul 10 19:57:16 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:17 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-07bcde7d-b307-47d5-bf81-d7f4abaa889e" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-quobyte-07bcde7d-b307-47d5-bf81-d7f4abaa889e" released by "delete_volume" :: held 1.610s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:17 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" returned: 0 in 0.899s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:17 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 Jul 10 19:57:17 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Created reservations ['49acdaa1-c263-4bd6-9709-417d1b6aa267', '28011776-0d84-422f-9a2a-99367b877b68', 'b4ac42cc-717a-4085-9346-bc592543a801', 'a5ca0ccd-cc80-47f4-9eb4-56e6398c709c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:17 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:17 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:17 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08c44f4-ad2d-4703-8934-d796ee566c8e -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66" returned: 0 in 0.808s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:17 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 is being set with open permissions: ugo+rw Jul 10 19:57:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:17 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 Jul 10 19:57:17 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:18 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" returned: 0 in 0.829s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:18 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2 Jul 10 19:57:18 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:18 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.813s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Deleted volume successfully. Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cb908ff7-6979-4957-b987-0bedb8a14ffb tempest-CreateVolumesFromSnapshotTest-694320618 None] Lock "cinder-07bcde7d-b307-47d5-bf81-d7f4abaa889e-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:18 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66" returned: 0 in 0.746s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:18 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info Jul 10 19:57:18 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:18 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f.b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" returned: 0 in 0.737s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2" released by "_delete_snapshot" :: held 3.484s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" released by "delete_snapshot" :: held 3.518s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Created reservations ['2ee73b33-1d92-48cc-8835-284acb51c05f', '94d43838-fe53-4c35-a669-5d37358e0d12', '473746b8-a9bb-443c-ac3f-512c1ddc80d0', '0904daf4-5e6e-45de-ae37-adfdfc2dceed'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:19 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Delete snapshot completed successfully. Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-f8842992-67ee-4bbd-8111-b67a2a7bcd24 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-b8f92245-6a7b-461c-bdb7-94a2e4ccc6e2-delete_snapshot" released by "delete_snapshot" :: held 3.716s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:19 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info" returned: 0 in 0.766s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:19 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info is being set with open permissions: ugo+rw Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:19 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info Jul 10 19:57:19 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-quobyte-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[688dccdb-0ccc-4534-9de9-7272352a7a85]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:19 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f Jul 10 19:57:19 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:19 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.info" returned: 0 in 0.712s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.984s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313958902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb73ba0-c1a7-4913-8834-a88a14e16662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:16Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Creating volume 1cb73ba0-c1a7-4913-8834-a88a14e16662 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:19 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:20 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 1073741824 Jul 10 19:57:20 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:20 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9c109743-4ae6-45a4-adca-ba7b23d43399 tempest-VolumeDependencyTests-760904881 None] Create snapshot completed successfully Jul 10 19:57:20 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" returned: 0 in 0.828s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:20 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f Jul 10 19:57:20 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:21 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 1073741824" returned: 0 in 1.012s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:21 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 Jul 10 19:57:21 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Flow 'volume_create_manager' (0be61000-0aa3-4c9b-894e-584fc3dabebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64597cbe-aa15-45ed-aebc-23b9c5b704d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64597cbe-aa15-45ed-aebc-23b9c5b704d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-684926275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57e3f28-ca10-42c9-a9c7-5d5caa40cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5995f156163942a2bbbb9c66e772b576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=283667c9-2bdd-46a8-81de-bf0e1a170d66,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:21Z,use_quota=True,user_id='21e75e0ccd2c425a865efd5c81dcc2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cde0094-59bf-4c3c-bf20-7b4e6ad9cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cde0094-59bf-4c3c-bf20-7b4e6ad9cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:21 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6b76f9-29b3-4fe6-a311-945b01ce6b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6b76f9-29b3-4fe6-a311-945b01ce6b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e57e3f28-ca10-42c9-a9c7-5d5caa40cf78', 'volume_name': 'volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78', 'volume_size': 1, 'snapshot_id': '283667c9-2bdd-46a8-81de-bf0e1a170d66'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81adb28a-f6a7-46d1-83fb-91265ed1aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81adb28a-f6a7-46d1-83fb-91265ed1aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5d1ba5-23af-4869-8974-b0dcfc64929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Volume e57e3f28-ca10-42c9-a9c7-5d5caa40cf78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78', 'volume_size': 1, 'snapshot_id': '283667c9-2bdd-46a8-81de-bf0e1a170d66'} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" returned: 0 in 0.901s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f" released by "delete_volume" :: held 1.798s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Created reservations ['dedfb281-769b-4263-bd2f-85795dfa48a8', '583279c8-d112-477a-9724-369113ff5317', '85b95a5f-955c-493f-bebd-eb1497a8f8a7', 'bb80e64d-f288-44dc-bbb8-ac83d523211c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:21 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:21 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:21 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662" returned: 0 in 0.812s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.294s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-quobyte-283667c9-2bdd-46a8-81de-bf0e1a170d66-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837c874c-bb3e-40a5-97dc-a37663e60c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb73ba0-c1a7-4913-8834-a88a14e16662', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0348e95-0eec-4e48-8171-a07a425144b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-283667c9-2bdd-46a8-81de-bf0e1a170d66-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Creating volume e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 from snapshot 283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-quobyte-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:21 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Volume volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 (1cb73ba0-c1a7-4913-8834-a88a14e16662): created successfully Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0348e95-0eec-4e48-8171-a07a425144b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (af9d650f-e06c-4cdd-809d-17f4925b9559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] snapshot: 283667c9-2bdd-46a8-81de-bf0e1a170d66, volume: e57e3f28-ca10-42c9-a9c7-5d5caa40cf78, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-e52d1f0a-4bca-4328-8b28-505942eb4a91-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9a005776-2ccc-43a2-8b00-ee96678e5569 tempest-ProjectReaderTests-873953946 None] Created volume successfully. Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce45ada-6d8e-400d-b283-3b811b25844f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-e52d1f0a-4bca-4328-8b28-505942eb4a91-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "cinder-quobyte-e52d1f0a-4bca-4328-8b28-505942eb4a91" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-e52d1f0a-4bca-4328-8b28-505942eb4a91" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[776eee70-f00b-44d3-a3e2-90c1c496f22c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:22 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 Jul 10 19:57:22 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:22 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 Jul 10 19:57:22 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-1cb73ba0-c1a7-4913-8834-a88a14e16662-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Lock "cinder-1cb73ba0-c1a7-4913-8834-a88a14e16662-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:22 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.929s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Deleted volume successfully. Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-quobyte-1cb73ba0-c1a7-4913-8834-a88a14e16662" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dfdd6bcf-521e-405f-97f8-95299c002091 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-36dd2b37-81fd-4102-bd3a-3e7fd242ac9f-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-1cb73ba0-c1a7-4913-8834-a88a14e16662" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[288900f7-3688-4a0f-b599-4a5182f0b8dc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:22 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 Jul 10 19:57:22 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:23 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66" returned: 0 in 1.035s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08c44f4-ad2d-4703-8934-d796ee566c8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86832cb-8563-47b2-9c27-2cf4d328e2a8]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:23 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:23 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:23 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91" returned: 0 in 1.178s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:23 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91 Jul 10 19:57:23 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:23 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662" returned: 0 in 0.908s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:23 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662 Jul 10 19:57:23 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:23 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 0.896s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:57:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:24 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 Jul 10 19:57:24 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:24 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e52d1f0a-4bca-4328-8b28-505942eb4a91" returned: 0 in 0.823s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Flow 'volume_create_manager' (c2390649-8e0f-49d9-9167-d872f6344db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808d4749-29e8-489e-ab54-530deda67fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-quobyte-e52d1f0a-4bca-4328-8b28-505942eb4a91" released by "delete_volume" :: held 2.088s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808d4749-29e8-489e-ab54-530deda67fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfefe16-4222-45f5-8d52-e0605ef41683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e242cce957554117bcbd14e9106a1a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:24Z,use_quota=True,user_id='cfebcb658dd546f097caefd1f80b8524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be2580c-51e4-4de7-bdb8-d3ac27c0c226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be2580c-51e4-4de7-bdb8-d3ac27c0c226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bf5012-a279-4321-b79d-f47b040b3979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.image.glance [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Creating Keystone auth plugin from conf {{(pid=87164) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Created reservations ['f0ecab1e-659c-487d-bcf5-e7cc1bd4b528', 'b9620d02-0e21-43fa-87c4-9375ca34221e', 'edd515d8-2def-4236-8d62-3178ef43c4cc', '0a65412f-b9ac-40ff-a4b0-a2c285c0062d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:24 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:24 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:24 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-1cb73ba0-c1a7-4913-8834-a88a14e16662" returned: 0 in 0.864s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-1cb73ba0-c1a7-4913-8834-a88a14e16662" released by "delete_volume" :: held 1.834s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Created reservations ['910ef08c-95b3-4263-8a13-6f9a04f0180f', '8180a4f0-dfd5-40d2-b38d-c9f37278c93f', 'cc017e4b-689c-4387-a7c1-35f5c100cc07', 'acb31296-0369-4bd3-9d96-4e12292fa394'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bf5012-a279-4321-b79d-f47b040b3979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bfefe16-4222-45f5-8d52-e0605ef41683', 'volume_name': 'volume-0bfefe16-4222-45f5-8d52-e0605ef41683', 'volume_size': 1, 'image_id': '6d028485-8750-4abc-b4d5-960db3554955', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d028485-8750-4abc-b4d5-960db3554955', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1237e12b3fb95436cee87d095a64decc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e242cce957554117bcbd14e9106a1a18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4ebf452db5d7f7503eeb666e2598b0f6ac677fb70e598e34eb25b41b4c1304475f7509ea2b0467ee57aefe39e3c9c1fdaa6e903229ac461b8534f1dcd611a53', 'id': '6d028485-8750-4abc-b4d5-960db3554955', 'created_at': datetime.datetime(2026, 7, 10, 17, 57, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 57, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d028485-8750-4abc-b4d5-960db3554955/file', 'properties': {}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73031c4-7771-4dca-842a-f220d870481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73031c4-7771-4dca-842a-f220d870481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:24 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:24 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b62e6b-08f8-4c41-929c-6d09cfa77207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Volume 0bfefe16-4222-45f5-8d52-e0605ef41683: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bfefe16-4222-45f5-8d52-e0605ef41683', 'volume_size': 1, 'image_id': '6d028485-8750-4abc-b4d5-960db3554955', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d028485-8750-4abc-b4d5-960db3554955', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1237e12b3fb95436cee87d095a64decc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e242cce957554117bcbd14e9106a1a18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4ebf452db5d7f7503eeb666e2598b0f6ac677fb70e598e34eb25b41b4c1304475f7509ea2b0467ee57aefe39e3c9c1fdaa6e903229ac461b8534f1dcd611a53', 'id': '6d028485-8750-4abc-b4d5-960db3554955', 'created_at': datetime.datetime(2026, 7, 10, 17, 57, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 57, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d028485-8750-4abc-b4d5-960db3554955/file', 'properties': {}}, 'image_service': } Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Trying to clone 0bfefe16-4222-45f5-8d52-e0605ef41683 from image 6d028485-8750-4abc-b4d5-960db3554955 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d028485-8750-4abc-b4d5-960db3554955', 'metadata': {}}]). {{(pid=87164) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 19:57:24 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Image download 0.00 MB at 0.00 MB/s Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca45c7d7-aff0-482a-9c2e-a4220c8b89cd]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:25 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD Jul 10 19:57:25 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:25 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.152s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:25 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Deleted volume successfully. Jul 10 19:57:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-00085de5-d853-4b1f-b705-adf0a30e6493 tempest-CinderUnicodeTest-1335976171 None] Lock "cinder-e52d1f0a-4bca-4328-8b28-505942eb4a91-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:26 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.928s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (8c39cd4e-0220-49f0-b088-949e6fe44457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364aed56-bc45-4cc3-8471-6054dab41982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:26 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Deleted volume successfully. Jul 10 19:57:26 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD" returned: 0 in 1.891s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364aed56-bc45-4cc3-8471-6054dab41982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43103776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0474202b-de94-4feb-a90a-0fd1293b97f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:26Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56254a60-fce5-4f85-b460-d545e168c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56254a60-fce5-4f85-b460-d545e168c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad03c8f5-b95e-49f7-9263-3a8020b8a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad03c8f5-b95e-49f7-9263-3a8020b8a176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0474202b-de94-4feb-a90a-0fd1293b97f3', 'volume_name': 'volume-0474202b-de94-4feb-a90a-0fd1293b97f3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:26 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142c7183-a485-4eb7-9950-612f64b3872d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142c7183-a485-4eb7-9950-612f64b3872d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:27 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80df19e6-217c-4952-9e5a-d7b3bfd83dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:27 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Volume 0474202b-de94-4feb-a90a-0fd1293b97f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0474202b-de94-4feb-a90a-0fd1293b97f3', 'volume_size': 1} Jul 10 19:57:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dcb75f20-adcb-429d-a1a1-609b993a0abb tempest-ProjectReaderTests-873953946 None] Lock "cinder-1cb73ba0-c1a7-4913-8834-a88a14e16662-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:27 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD Jul 10 19:57:27 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:28 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD" returned: 1 in 2.171s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:57:29 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Temporary image 6d028485-8750-4abc-b4d5-960db3554955 is fetched for user cfebcb658dd546f097caefd1f80b8524. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 19:57:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e2ab9-e330-4af5-8c6d-c7d0769dd3a5]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:29 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD Jul 10 19:57:29 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:30 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" returned: 0 in 6.489s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc9e4c8-8b19-4017-baa0-09a5cf79e6e0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:30 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD" returned: 0 in 1.376s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:30 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:30 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:30 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD Jul 10 19:57:30 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:31 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD" returned: 1 in 0.801s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:57:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:31 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 1.148s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:31 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:57:31 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Converted 1024.00 MB image at 157.78 MB/s Jul 10 19:57:31 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 is being set with open permissions: ugo+rw Jul 10 19:57:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:31 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 Jul 10 19:57:31 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:32 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" returned: 0 in 0.665s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" released by "_copy_volume_from_snapshot" :: held 10.364s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-283667c9-2bdd-46a8-81de-bf0e1a170d66-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" released by "_create_volume_from_snapshot" :: held 10.421s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.460s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.309s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43103776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0474202b-de94-4feb-a90a-0fd1293b97f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:26Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Creating volume 0474202b-de94-4feb-a90a-0fd1293b97f3 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:32 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:32 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 1073741824 Jul 10 19:57:32 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5d1ba5-23af-4869-8974-b0dcfc64929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78', 'volume_size': 1, 'snapshot_id': '283667c9-2bdd-46a8-81de-bf0e1a170d66'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2c5610-b20f-4cbb-bbf1-f77492d6db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Volume volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 (e57e3f28-ca10-42c9-a9c7-5d5caa40cf78): created successfully Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2c5610-b20f-4cbb-bbf1-f77492d6db35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Flow 'volume_create_manager' (0be61000-0aa3-4c9b-894e-584fc3dabebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-78dc2bca-2b53-45b8-9fe8-f920cf4613d2 tempest-VolumeDependencyTests-760904881 None] Created volume successfully. Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-283667c9-2bdd-46a8-81de-bf0e1a170d66-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-283667c9-2bdd-46a8-81de-bf0e1a170d66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-quobyte-d08c44f4-ad2d-4703-8934-d796ee566c8e" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-d08c44f4-ad2d-4703-8934-d796ee566c8e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-quobyte-283667c9-2bdd-46a8-81de-bf0e1a170d66" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-283667c9-2bdd-46a8-81de-bf0e1a170d66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Deleting offline snapshot 283667c9-2bdd-46a8-81de-bf0e1a170d66 of volume d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] snapshot_file for this snap is: volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[10182b74-8018-4714-8a9b-5cac902ef2dc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:32 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 Jul 10 19:57:32 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:33 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 1073741824" returned: 0 in 0.867s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:33 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 Jul 10 19:57:33 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:33 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66" returned: 0 in 0.830s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08c44f4-ad2d-4703-8934-d796ee566c8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2046d8b9-92dc-4265-b393-186bace5d4e5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:33 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:33 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:33 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3" returned: 0 in 0.719s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfefe16-4222-45f5-8d52-e0605ef41683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e242cce957554117bcbd14e9106a1a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:24Z,use_quota=True,user_id='cfebcb658dd546f097caefd1f80b8524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Creating volume 0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:34 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:34 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 1073741824 Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80df19e6-217c-4952-9e5a-d7b3bfd83dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0474202b-de94-4feb-a90a-0fd1293b97f3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f434fc-35a7-4217-8dc0-823325ebfe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:34 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Volume volume-0474202b-de94-4feb-a90a-0fd1293b97f3 (0474202b-de94-4feb-a90a-0fd1293b97f3): created successfully Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f434fc-35a7-4217-8dc0-823325ebfe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (8c39cd4e-0220-49f0-b088-949e6fe44457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:34 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-fa2d14cf-6f1c-4952-a811-75c4956b6596 tempest-ProjectReaderTests-873953946 None] Created volume successfully. Jul 10 19:57:34 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:34 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 0.990s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:34 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 Jul 10 19:57:34 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:35 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 1073741824" returned: 0 in 1.097s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:35 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:35 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-0474202b-de94-4feb-a90a-0fd1293b97f3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Lock "cinder-0474202b-de94-4feb-a90a-0fd1293b97f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-quobyte-0474202b-de94-4feb-a90a-0fd1293b97f3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-0474202b-de94-4feb-a90a-0fd1293b97f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c19571c-c412-4045-ae58-29a89bba17a9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:35 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 Jul 10 19:57:35 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:35 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66" returned: 0 in 1.030s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:35 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66 Jul 10 19:57:35 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:35 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 0 in 0.761s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:35 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Attempting download of 6d028485-8750-4abc-b4d5-960db3554955 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d028485-8750-4abc-b4d5-960db3554955', 'metadata': {}}])) to volume 0bfefe16-4222-45f5-8d52-e0605ef41683. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda2e514-3f80-4e46-aceb-0e8a9f65a855]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:36 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq Jul 10 19:57:36 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:36 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3" returned: 0 in 0.869s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:36 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3 Jul 10 19:57:36 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:36 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e.283667c9-2bdd-46a8-81de-bf0e1a170d66" returned: 0 in 0.842s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-283667c9-2bdd-46a8-81de-bf0e1a170d66" released by "_delete_snapshot" :: held 3.815s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-d08c44f4-ad2d-4703-8934-d796ee566c8e" released by "delete_snapshot" :: held 3.843s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Created reservations ['5ff95f94-f3e9-491d-87c4-9e5b03b682e0', 'e885fc31-9d84-4c41-a228-59cd4c0a24e1', 'f09275d6-5051-4e62-9a6f-9ff3db6898b2', 'fb9fe3c5-746b-4f20-8587-fd6cb1d5b83d'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Delete snapshot completed successfully. Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-7d6e11c6-0cf4-4902-9287-575d5984f18c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-283667c9-2bdd-46a8-81de-bf0e1a170d66-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:36 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq" returned: 0 in 0.853s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-d08c44f4-ad2d-4703-8934-d796ee566c8e-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-d08c44f4-ad2d-4703-8934-d796ee566c8e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:37 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq Jul 10 19:57:37 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-quobyte-d08c44f4-ad2d-4703-8934-d796ee566c8e" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-d08c44f4-ad2d-4703-8934-d796ee566c8e" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:37 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0474202b-de94-4feb-a90a-0fd1293b97f3" returned: 0 in 0.874s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-0474202b-de94-4feb-a90a-0fd1293b97f3" released by "delete_volume" :: held 1.802s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f1553-b8b1-4623-8586-29a8fcb5a019]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Created reservations ['57074528-8e79-48d4-9ef8-ddf062d56bf6', '9fcf35bf-14ff-4551-8ef0-4deebd9d8315', '1f70104c-50c2-47f2-9da8-d5e5d60a9cbe', 'ec22a6ad-c21e-4cdf-84f7-bce8c13ad418'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:37 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:37 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:37 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:37 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:37 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:37 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:38 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq" returned: 1 in 1.323s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d028485-8750-4abc-b4d5-960db3554955_5tde6jyq' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7b3131-c636-417d-9d5d-d294a65b89ab]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:38 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 1.108s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:38 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e Jul 10 19:57:38 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:38 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.057s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:38 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD Jul 10 19:57:38 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Deleted volume successfully. Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-458f81ab-2a85-4a08-bd5c-8dbec6bb19ba tempest-ProjectReaderTests-873953946 None] Lock "cinder-0474202b-de94-4feb-a90a-0fd1293b97f3-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (abe29f4f-93ec-47cb-85d2-cc1ef5ed934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fe7129-6b8c-4eec-a29c-0d96a2faf723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fe7129-6b8c-4eec-a29c-0d96a2faf723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58363683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09410efc-d917-4f83-b041-db8b4e5da6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:38Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db1e5a6-6786-4535-9320-c23eabc231f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db1e5a6-6786-4535-9320-c23eabc231f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f797d2b5-596a-441f-85da-823e12bc1a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f797d2b5-596a-441f-85da-823e12bc1a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09410efc-d917-4f83-b041-db8b4e5da6ac', 'volume_name': 'volume-09410efc-d917-4f83-b041-db8b4e5da6ac', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d35261-019c-4bb1-b6b9-b623f4faea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d35261-019c-4bb1-b6b9-b623f4faea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff117590-81a8-4b37-980e-64975b1a5ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:38 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Volume 09410efc-d917-4f83-b041-db8b4e5da6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09410efc-d917-4f83-b041-db8b4e5da6ac', 'volume_size': 1} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58363683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09410efc-d917-4f83-b041-db8b4e5da6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:38Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Creating volume 09410efc-d917-4f83-b041-db8b4e5da6ac {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:38 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:38 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.102s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:57:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:57:38 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac 1073741824 Jul 10 19:57:38 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:39 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-d08c44f4-ad2d-4703-8934-d796ee566c8e" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-d08c44f4-ad2d-4703-8934-d796ee566c8e" released by "delete_volume" :: held 2.030s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:39 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD" returned: 0 in 0.928s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Created reservations ['483606ad-c752-4d1d-bf9c-4c60e5df1329', '041229d1-1fc3-4443-80ba-d504986b206c', '87c84866-9222-484c-a526-33697ab124ee', '24083355-f5c0-4913-adb4-b0562f35b3a8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:39 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD Jul 10 19:57:39 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:39 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:39 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:39 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac 1073741824" returned: 0 in 0.991s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:39 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac Jul 10 19:57:39 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:40 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD" returned: 1 in 0.933s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] 6d028485-8750-4abc-b4d5-960db3554955 was raw, converting to raw {{(pid=87164) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:40 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:40 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:40 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.835s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Deleted volume successfully. Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-273f9d00-71bc-4a7a-957e-dc49fdca8b91 tempest-VolumeDependencyTests-760904881 None] Lock "cinder-d08c44f4-ad2d-4703-8934-d796ee566c8e-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Acquiring lock "cinder-quobyte-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[057ed1f6-5880-4c9c-8e49-187328d96c43]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:40 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac" returned: 0 in 0.854s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff117590-81a8-4b37-980e-64975b1a5ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09410efc-d917-4f83-b041-db8b4e5da6ac', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d345fd0-db7a-4540-a090-a6717ebfe8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:40 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Volume volume-09410efc-d917-4f83-b041-db8b4e5da6ac (09410efc-d917-4f83-b041-db8b4e5da6ac): created successfully Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d345fd0-db7a-4540-a090-a6717ebfe8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (abe29f4f-93ec-47cb-85d2-cc1ef5ed934f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e384fba1-0935-4720-b59a-e50b71ff1c4f tempest-ProjectReaderTests-873953946 None] Created volume successfully. Jul 10 19:57:40 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 Jul 10 19:57:40 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:40 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 0 in 0.797s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d028485-8750-4abc-b4d5-960db3554955_2wvy2a03devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:57:40 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 19:57:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:40 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 1G Jul 10 19:57:40 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:41 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:41 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78 Jul 10 19:57:41 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:41 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 1G" returned: 0 in 0.772s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ce34a5-85cf-47ec-b367-bf3061e1aad1]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-09410efc-d917-4f83-b041-db8b4e5da6ac-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Lock "cinder-09410efc-d917-4f83-b041-db8b4e5da6ac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:41 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:41 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-quobyte-09410efc-d917-4f83-b041-db8b4e5da6ac" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-09410efc-d917-4f83-b041-db8b4e5da6ac" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4325be-6de6-4a08-b3cc-0091ac0271af]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:42 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac Jul 10 19:57:42 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:42 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" returned: 0 in 0.832s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-quobyte-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78" released by "delete_volume" :: held 1.690s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Created reservations ['3db0038c-04b0-4c41-b272-d78d3fc5b667', '774ce4b5-bbda-4c21-9c85-cd9a89b30413', '01b62fb8-a447-42d6-977c-a1fe6784a6bd', '11811fa1-6c14-4772-89ec-cd9d3a7ad280'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:42 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:42 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:42 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 0 in 0.901s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:42 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:42 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:42 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac" returned: 0 in 1.016s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:43 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac Jul 10 19:57:43 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:43 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.745s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Deleted volume successfully. Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-41aea70b-7e15-4544-bd1e-d89c6ad1d51c tempest-VolumeDependencyTests-760904881 None] Lock "cinder-e57e3f28-ca10-42c9-a9c7-5d5caa40cf78-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:43 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 1 in 0.942s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Downloaded image 6d028485-8750-4abc-b4d5-960db3554955 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d028485-8750-4abc-b4d5-960db3554955', 'metadata': {}}])) to volume 0bfefe16-4222-45f5-8d52-e0605ef41683 successfully. {{(pid=87164) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Temporary image 6d028485-8750-4abc-b4d5-960db3554955 for user cfebcb658dd546f097caefd1f80b8524 is deleted. {{(pid=87164) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.volume_utils [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Marking volume 0bfefe16-4222-45f5-8d52-e0605ef41683 as bootable. {{(pid=87164) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Copying metadata from image 6d028485-8750-4abc-b4d5-960db3554955 to 0bfefe16-4222-45f5-8d52-e0605ef41683. {{(pid=87164) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Creating volume glance metadata for volume 0bfefe16-4222-45f5-8d52-e0605ef41683 backed by image 6d028485-8750-4abc-b4d5-960db3554955 with: {'image_id': '6d028485-8750-4abc-b4d5-960db3554955', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1237e12b3fb95436cee87d095a64decc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87164) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b62e6b-08f8-4c41-929c-6d09cfa77207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfefe16-4222-45f5-8d52-e0605ef41683', 'volume_size': 1, 'image_id': '6d028485-8750-4abc-b4d5-960db3554955', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d028485-8750-4abc-b4d5-960db3554955', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1237e12b3fb95436cee87d095a64decc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e242cce957554117bcbd14e9106a1a18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4ebf452db5d7f7503eeb666e2598b0f6ac677fb70e598e34eb25b41b4c1304475f7509ea2b0467ee57aefe39e3c9c1fdaa6e903229ac461b8534f1dcd611a53', 'id': '6d028485-8750-4abc-b4d5-960db3554955', 'created_at': datetime.datetime(2026, 7, 10, 17, 57, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 17, 57, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d028485-8750-4abc-b4d5-960db3554955/file', 'properties': {}}, 'image_service': }' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9d5950-9426-4afc-98b2-fdca50b95be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:43 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Volume volume-0bfefe16-4222-45f5-8d52-e0605ef41683 (0bfefe16-4222-45f5-8d52-e0605ef41683): created successfully Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9d5950-9426-4afc-98b2-fdca50b95be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Flow 'volume_create_manager' (c2390649-8e0f-49d9-9167-d872f6344db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-f8861af6-ad6c-4a88-b25d-01b34c499684 tempest-VolumeImageDependencyTests-1281131796 None] Created volume successfully. Jul 10 19:57:43 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-09410efc-d917-4f83-b041-db8b4e5da6ac" returned: 0 in 0.884s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-09410efc-d917-4f83-b041-db8b4e5da6ac" released by "delete_volume" :: held 1.969s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:43 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Created reservations ['f353f897-0952-4ff6-9562-5e4ff5962ca6', '5ccbc6d4-bc35-4fa9-90c4-bc8f904a66cf', '5acc6c4e-fcb1-41ce-94a3-2118ef6d6163', 'a145be4c-d862-43ef-8d96-a7d2bf947e88'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:44 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:44 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Acquiring lock "cinder-0bfefe16-4222-45f5-8d52-e0605ef41683-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Lock "cinder-0bfefe16-4222-45f5-8d52-e0605ef41683-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Acquiring lock "cinder-quobyte-0bfefe16-4222-45f5-8d52-e0605ef41683" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Lock "cinder-quobyte-0bfefe16-4222-45f5-8d52-e0605ef41683" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c530a6f-f8d6-4c36-8f65-3b5e4cc00871]: (4, 'raw') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (3e9074de-6291-45ae-a617-d537108a485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6013d2-b0d4-4ba1-8ed8-5eead4eda37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6013d2-b0d4-4ba1-8ed8-5eead4eda37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954119426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c55d88c-461a-4114-ac82-ec8f31a789de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:45Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c9a553-7ee9-4c33-b988-c54d27285765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c9a553-7ee9-4c33-b988-c54d27285765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413393e8-0768-4a5d-96fd-fa73cc48bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:45 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:45 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413393e8-0768-4a5d-96fd-fa73cc48bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c55d88c-461a-4114-ac82-ec8f31a789de', 'volume_name': 'volume-7c55d88c-461a-4114-ac82-ec8f31a789de', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef215ad-3f0b-450e-855c-8c389521dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef215ad-3f0b-450e-855c-8c389521dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d7c1f4-8a6d-499f-9e91-cd7e6b09bdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:45 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Volume 7c55d88c-461a-4114-ac82-ec8f31a789de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c55d88c-461a-4114-ac82-ec8f31a789de', 'volume_size': 1} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954119426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c55d88c-461a-4114-ac82-ec8f31a789de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f69ae48cf745b2a0201601506fcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:45Z,use_quota=True,user_id='08e2d2c9398647a3970d045e92b03a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Creating volume 7c55d88c-461a-4114-ac82-ec8f31a789de {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:45 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:45 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.097s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:45 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de 1073741824 Jul 10 19:57:45 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Deleted volume successfully. Jul 10 19:57:45 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-2cef5d01-bbc5-4636-b3c0-3b0b1768de10 tempest-ProjectReaderTests-873953946 None] Lock "cinder-09410efc-d917-4f83-b041-db8b4e5da6ac-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:46 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 0 in 1.209s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:46 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de 1073741824" returned: 0 in 1.124s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:46 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:46 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:46 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de Jul 10 19:57:46 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:47 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 1 in 1.038s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683' failed. Not Retrying. {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:47 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:47 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683 Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de" returned: 0 in 0.886s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:47 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d7c1f4-8a6d-499f-9e91-cd7e6b09bdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c55d88c-461a-4114-ac82-ec8f31a789de', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b03ace-1f37-4db7-b456-740683432641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:47 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Volume volume-7c55d88c-461a-4114-ac82-ec8f31a789de (7c55d88c-461a-4114-ac82-ec8f31a789de): created successfully Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b03ace-1f37-4db7-b456-740683432641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Flow 'volume_create_manager' (3e9074de-6291-45ae-a617-d537108a485e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-46a9eefd-ac5b-4728-b61f-0e035319c474 tempest-ProjectReaderTests-873953946 None] Created volume successfully. Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-e9f740f8-8a13-4cea-a71a-96ecb68aa974 tempest-ProjectAdminTests-221560394 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7570419311523, 'free_capacity_gb': 1775.7570419311523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87164) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 19:57:47 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0bfefe16-4222-45f5-8d52-e0605ef41683" returned: 0 in 0.739s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Lock "cinder-quobyte-0bfefe16-4222-45f5-8d52-e0605ef41683" released by "delete_volume" :: held 3.084s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Created reservations ['3cd617e2-e9c3-4fbf-88b1-58fe63ff2bb4', '4f23e082-ef87-4940-9428-426bb95c904b', '583e4e6f-c9dd-4435-b670-45159c346b51', 'd7625e80-e8ae-45e4-b8bb-0ce87d4c1671'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:48 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:48 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-7c55d88c-461a-4114-ac82-ec8f31a789de-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Lock "cinder-7c55d88c-461a-4114-ac82-ec8f31a789de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Acquiring lock "cinder-quobyte-7c55d88c-461a-4114-ac82-ec8f31a789de" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-7c55d88c-461a-4114-ac82-ec8f31a789de" acquired by "delete_volume" :: waited 0.027s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e69e27-d8a5-4011-83cb-3212e287fb72]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:48 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de Jul 10 19:57:48 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:48 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.878s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Deleted volume successfully. Jul 10 19:57:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-acb1bb25-5ddb-4bca-be65-848372090885 tempest-VolumeImageDependencyTests-1281131796 None] Lock "cinder-0bfefe16-4222-45f5-8d52-e0605ef41683-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:49 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de" returned: 0 in 1.144s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:49 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de Jul 10 19:57:49 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:50 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-7c55d88c-461a-4114-ac82-ec8f31a789de" returned: 0 in 0.728s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Lock "cinder-quobyte-7c55d88c-461a-4114-ac82-ec8f31a789de" released by "delete_volume" :: held 1.953s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Created reservations ['c74abda1-ac40-437d-914c-b1151e3597e9', '7d77e103-835d-411d-8252-ff60dc213014', '4693a27b-c02e-43f8-b55f-eed2dc47edb0', '60509332-5931-45e8-b13a-d57012f60850'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:50 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:57:50 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:51 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.861s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:51 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:57:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Deleted volume successfully. Jul 10 19:57:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-bc2b8138-c0b1-438e-b834-577be9c02755 tempest-ProjectReaderTests-873953946 None] Lock "cinder-7c55d88c-461a-4114-ac82-ec8f31a789de-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (d310ceba-b323-47f3-bd88-418896d60eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042a10be-dc9c-465a-965f-26ccdf9e9875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042a10be-dc9c-465a-965f-26ccdf9e9875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340260107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125965d6-93e5-4444-845f-f3f908082a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:55Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0350255-7fc7-4b4d-af79-9daed0de97ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0350255-7fc7-4b4d-af79-9daed0de97ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5726c3c7-007b-48e7-af46-31928b4f5cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5726c3c7-007b-48e7-af46-31928b4f5cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125965d6-93e5-4444-845f-f3f908082a0b', 'volume_name': 'volume-125965d6-93e5-4444-845f-f3f908082a0b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f830f181-2952-48c0-ad70-9bb2b803ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f830f181-2952-48c0-ad70-9bb2b803ef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a87e1ee-cc9a-4602-91bc-5210738ec43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Volume 125965d6-93e5-4444-845f-f3f908082a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125965d6-93e5-4444-845f-f3f908082a0b', 'volume_size': 1} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340260107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125965d6-93e5-4444-845f-f3f908082a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:55Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Creating volume 125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:57:54 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:57:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:54 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b 1073741824 Jul 10 19:57:54 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:55 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b 1073741824" returned: 0 in 1.008s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:55 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b Jul 10 19:57:55 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:56 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b" returned: 0 in 0.723s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a87e1ee-cc9a-4602-91bc-5210738ec43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125965d6-93e5-4444-845f-f3f908082a0b', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b1d318-b858-44db-9947-ff4e022b555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:56 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Volume volume-125965d6-93e5-4444-845f-f3f908082a0b (125965d6-93e5-4444-845f-f3f908082a0b): created successfully Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b1d318-b858-44db-9947-ff4e022b555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:56 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (d310ceba-b323-47f3-bd88-418896d60eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:56 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2c56e73b-d128-420c-807a-9fba4272b532 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:57:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:57:57 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 88df77c9-3129-4dcd-944a-04343a5e83c8 of volume 125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:57:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[100cf46e-8eb6-4c72-ac04-df7c4f164294]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:57:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:57 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b Jul 10 19:57:57 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:58 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b" returned: 0 in 0.861s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:58 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 1G Jul 10 19:57:58 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (4fdbb7f3-b51a-4e1b-b2b4-68eb0760fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad66f014-6134-4d78-b262-483e1df9a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:59 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad66f014-6134-4d78-b262-483e1df9a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498328578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e592384-fc20-4631-b08b-5074c00e27a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:59Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea6a0a2-3d85-42db-9c2d-2d17a0ad77e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea6a0a2-3d85-42db-9c2d-2d17a0ad77e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739eff71-e421-4bf3-a08c-cb075d394e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739eff71-e421-4bf3-a08c-cb075d394e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e592384-fc20-4631-b08b-5074c00e27a3', 'volume_name': 'volume-3e592384-fc20-4631-b08b-5074c00e27a3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9c75f0-cd2d-409a-8070-4c6b7823ae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9c75f0-cd2d-409a-8070-4c6b7823ae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88868d-39c4-42e3-817a-76710684f408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:57:59 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Volume 3e592384-fc20-4631-b08b-5074c00e27a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e592384-fc20-4631-b08b-5074c00e27a3', 'volume_size': 1} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 1G" returned: 0 in 1.040s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:57:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125965d6-93e5-4444-845f-f3f908082a0b -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:57:59 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125965d6-93e5-4444-845f-f3f908082a0b -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 Jul 10 19:57:59 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:00 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125965d6-93e5-4444-845f-f3f908082a0b -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8" returned: 0 in 0.832s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:00 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 is being set with open permissions: ugo+rw Jul 10 19:58:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:00 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 Jul 10 19:58:00 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:00 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8" returned: 0 in 0.699s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:00 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info Jul 10 19:58:00 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:01 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:01 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info is being set with open permissions: ugo+rw Jul 10 19:58:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:01 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info Jul 10 19:58:01 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:02 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.info" returned: 0 in 0.702s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.934s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.973s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498328578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e592384-fc20-4631-b08b-5074c00e27a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:57:59Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Creating volume 3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:02 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:02 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 1073741824 Jul 10 19:58:02 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:02 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2c3601b0-d720-407c-8f41-4f4a287029bc tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-88df77c9-3129-4dcd-944a-04343a5e83c8-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-88df77c9-3129-4dcd-944a-04343a5e83c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-125965d6-93e5-4444-845f-f3f908082a0b" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-125965d6-93e5-4444-845f-f3f908082a0b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-88df77c9-3129-4dcd-944a-04343a5e83c8" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-88df77c9-3129-4dcd-944a-04343a5e83c8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 88df77c9-3129-4dcd-944a-04343a5e83c8 of volume 125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8799611a-ddbb-4ca1-af47-7b653729b767]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:02 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 Jul 10 19:58:02 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:03 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 1073741824" returned: 0 in 0.955s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:03 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 Jul 10 19:58:03 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:03 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8" returned: 0 in 0.907s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125965d6-93e5-4444-845f-f3f908082a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:03 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3d4a4-b023-4a5c-9fda-81cd6e62463d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:03 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b Jul 10 19:58:03 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:04 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3" returned: 0 in 0.705s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88868d-39c4-42e3-817a-76710684f408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e592384-fc20-4631-b08b-5074c00e27a3', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa834d2e-3ee6-4aae-a10c-0b053412b479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Volume volume-3e592384-fc20-4631-b08b-5074c00e27a3 (3e592384-fc20-4631-b08b-5074c00e27a3): created successfully Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa834d2e-3ee6-4aae-a10c-0b053412b479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (4fdbb7f3-b51a-4e1b-b2b4-68eb0760fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:04 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-7b315d42-3b8a-4acf-9220-b5db789b975f tempest-ProjectReaderTests-1298506470 None] Created volume successfully. Jul 10 19:58:04 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:04 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 Jul 10 19:58:04 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Creating offline snapshot 63383174-8f26-4f3c-b447-c87e66aca934 of volume 3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a073ebc1-14ca-41df-b64a-8b849c074867]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:04 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 Jul 10 19:58:04 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:05 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8" returned: 0 in 0.814s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:05 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8 Jul 10 19:58:05 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:05 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3" returned: 0 in 0.923s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:05 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 1G Jul 10 19:58:05 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:06 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b.88df77c9-3129-4dcd-944a-04343a5e83c8" returned: 0 in 0.794s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-88df77c9-3129-4dcd-944a-04343a5e83c8" released by "_delete_snapshot" :: held 3.522s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-125965d6-93e5-4444-845f-f3f908082a0b" released by "delete_snapshot" :: held 3.547s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Created reservations ['f14b7547-74d8-4a10-829f-935229157045', 'acd6c761-a656-43e3-b197-b5aaf2db7aa3', 'ad638e16-bd4f-4490-b1c0-aec0db2b0f75', 'e2a58b25-9591-4a2b-91d5-410c1b1cd1d0'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-67255e66-d00e-413b-ad35-6bd605d69274 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-88df77c9-3129-4dcd-944a-04343a5e83c8-delete_snapshot" released by "delete_snapshot" :: held 3.728s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:06 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 1G" returned: 0 in 0.965s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e592384-fc20-4631-b08b-5074c00e27a3 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:06 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e592384-fc20-4631-b08b-5074c00e27a3 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 Jul 10 19:58:06 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-125965d6-93e5-4444-845f-f3f908082a0b-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-125965d6-93e5-4444-845f-f3f908082a0b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-125965d6-93e5-4444-845f-f3f908082a0b" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-125965d6-93e5-4444-845f-f3f908082a0b" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:07 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e731a-84d0-47d3-8e67-5a12c37347d3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:07 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b Jul 10 19:58:07 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:07 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e592384-fc20-4631-b08b-5074c00e27a3 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934" returned: 0 in 0.980s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:07 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 is being set with open permissions: ugo+rw Jul 10 19:58:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:07 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 Jul 10 19:58:07 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:08 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b" returned: 0 in 1.047s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:08 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b Jul 10 19:58:08 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:08 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934" returned: 0 in 0.701s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:08 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info Jul 10 19:58:08 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:08 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-125965d6-93e5-4444-845f-f3f908082a0b" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-125965d6-93e5-4444-845f-f3f908082a0b" released by "delete_volume" :: held 1.846s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:08 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Created reservations ['731d41c5-6153-49c6-ad67-44e93cbe2fc3', '17a9da90-358d-44ce-a7c5-84ff586ab017', '7116e642-df67-4dc8-9cd6-913c114f41ff', '308e28f1-3e96-4950-9780-b58ec93940fa'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:09 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:09 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:09 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info" returned: 0 in 0.713s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:09 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info is being set with open permissions: ugo+rw Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:09 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info Jul 10 19:58:09 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (1311b423-0e96-4953-a561-cda4db1e34a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604e8da8-6fea-4091-952d-58e02b8c8369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604e8da8-6fea-4091-952d-58e02b8c8369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871404342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470b0b29-db20-4199-8000-8cb37359afd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:10Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e373d1b8-9d9f-434e-9e37-fe026fe85733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e373d1b8-9d9f-434e-9e37-fe026fe85733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db22d8e-6118-478e-8b7f-b03205b07e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db22d8e-6118-478e-8b7f-b03205b07e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470b0b29-db20-4199-8000-8cb37359afd4', 'volume_name': 'volume-470b0b29-db20-4199-8000-8cb37359afd4', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1231955e-c993-44af-b8f7-a2c3b17a68da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1231955e-c993-44af-b8f7-a2c3b17a68da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46803342-a4be-4b3e-aa9f-9009fb5e208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:09 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Volume 470b0b29-db20-4199-8000-8cb37359afd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470b0b29-db20-4199-8000-8cb37359afd4', 'volume_size': 1} Jul 10 19:58:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:10 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 1.036s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b8b82036-4b81-40ad-a319-d6c609ab6fc6 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-125965d6-93e5-4444-845f-f3f908082a0b-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:10 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.info" returned: 0 in 1.022s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.401s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871404342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470b0b29-db20-4199-8000-8cb37359afd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:10Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Creating volume 470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:10 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:10 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 1073741824 Jul 10 19:58:10 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d5003d11-6ee6-4d32-9fed-85321d224cab tempest-ProjectReaderTests-1298506470 None] Create snapshot completed successfully Jul 10 19:58:11 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 1073741824" returned: 0 in 0.941s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:11 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 Jul 10 19:58:11 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-63383174-8f26-4f3c-b447-c87e66aca934-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-63383174-8f26-4f3c-b447-c87e66aca934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-3e592384-fc20-4631-b08b-5074c00e27a3" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3e592384-fc20-4631-b08b-5074c00e27a3" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-63383174-8f26-4f3c-b447-c87e66aca934" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Flow 'volume_create_manager' (62399bb8-bb58-4f32-9a29-eed42cd4660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c122394b-d019-4ba5-aa5c-8b5160f0e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-63383174-8f26-4f3c-b447-c87e66aca934" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Deleting offline snapshot 63383174-8f26-4f3c-b447-c87e66aca934 of volume 3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] snapshot_file for this snap is: volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[33694c70-0deb-44ba-9d99-031342b61fa6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c122394b-d019-4ba5-aa5c-8b5160f0e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1921788115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ab8a57-dabf-4000-8e79-318ec5eecf00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6315aa72874a6ab33c8f0ff81e1811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:11Z,use_quota=True,user_id='a71605d281284cc5af6a49d7a36bc5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e14ad3c-6ba8-4a29-9bbc-2e9d0b814086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e14ad3c-6ba8-4a29-9bbc-2e9d0b814086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380e1bb6-d7d7-4669-a52e-ae2812d80029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380e1bb6-d7d7-4669-a52e-ae2812d80029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ab8a57-dabf-4000-8e79-318ec5eecf00', 'volume_name': 'volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea5cc69-031f-4bab-bd29-cf9dda5d2453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea5cc69-031f-4bab-bd29-cf9dda5d2453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4f3719-77bc-4ae6-960d-1f704766ccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:11 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Volume c7ab8a57-dabf-4000-8e79-318ec5eecf00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00', 'volume_size': 1} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:11 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 Jul 10 19:58:11 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:11 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4" returned: 0 in 0.707s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1921788115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ab8a57-dabf-4000-8e79-318ec5eecf00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6315aa72874a6ab33c8f0ff81e1811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:11Z,use_quota=True,user_id='a71605d281284cc5af6a49d7a36bc5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Creating volume c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:11 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46803342-a4be-4b3e-aa9f-9009fb5e208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470b0b29-db20-4199-8000-8cb37359afd4', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9952b6-17b3-4063-9572-d2c4226cbd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:11 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 1073741824 Jul 10 19:58:11 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:11 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Volume volume-470b0b29-db20-4199-8000-8cb37359afd4 (470b0b29-db20-4199-8000-8cb37359afd4): created successfully Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9952b6-17b3-4063-9572-d2c4226cbd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:11 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (1311b423-0e96-4953-a561-cda4db1e34a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:11 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-caff089b-230f-42bf-a3b9-ca5a79cfaed1 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:58:12 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e592384-fc20-4631-b08b-5074c00e27a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5e81c-cc73-42dd-a3f5-4931f14924ba]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:12 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 Jul 10 19:58:12 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:12 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 1073741824" returned: 0 in 0.815s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:12 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:12 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:13 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3" returned: 0 in 0.846s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:13 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 Jul 10 19:58:13 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:13 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.683s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.251s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4f3719-77bc-4ae6-960d-1f704766ccd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6af041-fec7-4d96-83b0-1f663e20e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 72bbb3de-e660-4faa-9633-f581fe4fa0a7 of volume 470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:13 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Volume volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 (c7ab8a57-dabf-4000-8e79-318ec5eecf00): created successfully Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6af041-fec7-4d96-83b0-1f663e20e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Flow 'volume_create_manager' (62399bb8-bb58-4f32-9a29-eed42cd4660b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cb0274-cb0e-42a8-94dd-ba3da83872cc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:13 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-4f41c181-82cd-4988-a3be-c23d76ff202d tempest-SnapshotDependencyTests-103665677 None] Created volume successfully. Jul 10 19:58:13 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 Jul 10 19:58:13 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:13 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934" returned: 0 in 0.774s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:13 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934 Jul 10 19:58:13 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:14 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4" returned: 0 in 0.804s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:14 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 1G Jul 10 19:58:14 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:14 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3.63383174-8f26-4f3c-b447-c87e66aca934" returned: 0 in 0.660s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-63383174-8f26-4f3c-b447-c87e66aca934" released by "_delete_snapshot" :: held 3.218s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3e592384-fc20-4631-b08b-5074c00e27a3" released by "delete_snapshot" :: held 3.283s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Created reservations ['1e0e1409-be5a-4b89-adcf-f3ca0c38577c', 'a9fd017a-1ecd-4577-813b-dd8d64802f0f', '15cd051e-43fe-401f-a438-4c7043642778', 'c0bcbf65-35d2-439c-af0d-34130fc1f04f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Delete snapshot completed successfully. Jul 10 19:58:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-a4a6bb01-29b8-4e8a-9aa7-8a87e4d326a3 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-63383174-8f26-4f3c-b447-c87e66aca934-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:15 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 1G" returned: 0 in 0.836s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470b0b29-db20-4199-8000-8cb37359afd4 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:15 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470b0b29-db20-4199-8000-8cb37359afd4 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 Jul 10 19:58:15 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-3e592384-fc20-4631-b08b-5074c00e27a3-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-3e592384-fc20-4631-b08b-5074c00e27a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=118,cinder:INSERT=44,cinder:UPDATE=160,cinder:DELETE=11 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=118,cinder:INSERT=41,cinder:UPDATE=144,cinder:DELETE=14 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-3e592384-fc20-4631-b08b-5074c00e27a3" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3e592384-fc20-4631-b08b-5074c00e27a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d22eb0f-3f8a-455a-a053-f7ddd38a1f33]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:15 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 Jul 10 19:58:15 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:15 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470b0b29-db20-4199-8000-8cb37359afd4 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7" returned: 0 in 0.742s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:15 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 is being set with open permissions: ugo+rw Jul 10 19:58:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:15 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 Jul 10 19:58:15 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:16 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:16 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3 Jul 10 19:58:16 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:16 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:16 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info Jul 10 19:58:16 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:17 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3e592384-fc20-4631-b08b-5074c00e27a3" returned: 0 in 0.697s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3e592384-fc20-4631-b08b-5074c00e27a3" released by "delete_volume" :: held 1.549s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Created reservations ['d98353f6-f11b-46e9-b965-e69fa8ea71f2', '8fbab732-722c-4022-8b7f-0cfcef95f638', 'f3573350-d3c2-4d5d-9d99-1d726ae2e93b', 'f8d721a8-4ab0-41fe-ba69-3e8cb43f1298'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:17 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info" returned: 0 in 0.681s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:17 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info is being set with open permissions: ugo+rw Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:17 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:17 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:17 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info Jul 10 19:58:17 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:17 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.info" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.546s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:17 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.238s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.727s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Deleted volume successfully. Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Creating offline snapshot 69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f of volume c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-44ef9849-dd32-4a3c-bb72-0c79b717e07b tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-72e09930-35c5-4470-b9e0-357fc0452fd2 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-3e592384-fc20-4631-b08b-5074c00e27a3-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf30a5b7-0e67-413b-8d60-2c7cc8326b1b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:18 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:18 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (f23ce57b-9f21-47a3-a26d-dac22e8ebbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95608a9f-7779-450c-be81-400aa96e9a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95608a9f-7779-450c-be81-400aa96e9a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659328940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e606be-304d-41a6-9ffd-806fb32ad55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:18Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf78d80-8ee7-4547-aaba-638b8c733268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf78d80-8ee7-4547-aaba-638b8c733268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70859320-7e6c-4c96-8de9-7d5b1117a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70859320-7e6c-4c96-8de9-7d5b1117a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e606be-304d-41a6-9ffd-806fb32ad55d', 'volume_name': 'volume-a4e606be-304d-41a6-9ffd-806fb32ad55d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4af665-c220-47eb-9e07-55119b51bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4af665-c220-47eb-9e07-55119b51bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1229f5e4-b6cd-4dec-a5ee-0e16df7085c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:18 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Volume a4e606be-304d-41a6-9ffd-806fb32ad55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e606be-304d-41a6-9ffd-806fb32ad55d', 'volume_size': 1} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-72bbb3de-e660-4faa-9633-f581fe4fa0a7-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-72bbb3de-e660-4faa-9633-f581fe4fa0a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-470b0b29-db20-4199-8000-8cb37359afd4" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-470b0b29-db20-4199-8000-8cb37359afd4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-72bbb3de-e660-4faa-9633-f581fe4fa0a7" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-72bbb3de-e660-4faa-9633-f581fe4fa0a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 72bbb3de-e660-4faa-9633-f581fe4fa0a7 of volume 470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf628b9-fa7e-4f46-841e-4101a726e1c0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:18 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 Jul 10 19:58:18 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:18 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.784s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:18 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f 1G Jul 10 19:58:18 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:19 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7" returned: 0 in 0.788s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:19 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-470b0b29-db20-4199-8000-8cb37359afd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310b15c-8ad9-41b5-9eef-be404a92a56b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:19 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 Jul 10 19:58:19 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:19 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f 1G" returned: 0 in 0.844s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:19 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f Jul 10 19:58:19 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:20 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4" returned: 0 in 0.804s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:20 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 Jul 10 19:58:20 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:20 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:20 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f is being set with open permissions: ugo+rw Jul 10 19:58:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:20 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f Jul 10 19:58:20 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:20 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7" returned: 0 in 0.751s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:20 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7 Jul 10 19:58:20 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:21 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" returned: 0 in 0.678s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:21 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info Jul 10 19:58:21 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:21 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4.72bbb3de-e660-4faa-9633-f581fe4fa0a7" returned: 0 in 0.676s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-72bbb3de-e660-4faa-9633-f581fe4fa0a7" released by "_delete_snapshot" :: held 3.130s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-470b0b29-db20-4199-8000-8cb37359afd4" released by "delete_snapshot" :: held 3.153s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Created reservations ['7c5433fe-8c3c-4a42-bc7b-5d75b303e0cc', '53ada57e-5753-49f8-9543-b0763f2abc40', '089359d8-b85c-477a-8ffe-c8e833f026a5', 'e521a425-e225-458d-97a9-b79dfb432d88'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d97b3912-dbca-40d4-a473-3e8bf96a5418 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-72bbb3de-e660-4faa-9633-f581fe4fa0a7-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:21 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info" returned: 0 in 0.687s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:21 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info is being set with open permissions: ugo+rw Jul 10 19:58:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:21 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info Jul 10 19:58:21 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:22 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.info" returned: 0 in 0.644s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.143s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659328940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e606be-304d-41a6-9ffd-806fb32ad55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:18Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Creating volume a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:22 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:22 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d 1073741824 Jul 10 19:58:22 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:22 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-2c7f0d71-c88c-4568-9e62-d2dd6469a272 tempest-SnapshotDependencyTests-103665677 None] Create snapshot completed successfully Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-470b0b29-db20-4199-8000-8cb37359afd4-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Lock "cinder-470b0b29-db20-4199-8000-8cb37359afd4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-470b0b29-db20-4199-8000-8cb37359afd4" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-470b0b29-db20-4199-8000-8cb37359afd4" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[704ed3b0-554f-45cb-bc5a-9e48c4dc3650]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:22 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 Jul 10 19:58:22 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:23 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d 1073741824" returned: 0 in 0.913s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:23 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d Jul 10 19:58:23 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:23 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4" returned: 0 in 0.889s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:23 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4 Jul 10 19:58:23 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Flow 'volume_create_manager' (51e9338d-5af1-41c2-8ad0-c9521abcbbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af41a76-32eb-4101-b5a0-2426c6199fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af41a76-32eb-4101-b5a0-2426c6199fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35ed8e0-35d5-44d2-ad35-6552f8dd3531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc6315aa72874a6ab33c8f0ff81e1811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:24Z,use_quota=True,user_id='a71605d281284cc5af6a49d7a36bc5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b042621c-6a1e-4300-a446-c61478b3ac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b042621c-6a1e-4300-a446-c61478b3ac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714b3d01-55c8-40d0-9e64-8c1b8b76672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714b3d01-55c8-40d0-9e64-8c1b8b76672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b35ed8e0-35d5-44d2-ad35-6552f8dd3531', 'volume_name': 'volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531', 'volume_size': 1, 'snapshot_id': '69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228cd93e-87cf-4505-9754-f7b5b7b19769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228cd93e-87cf-4505-9754-f7b5b7b19769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51985bf-bc10-461d-9cc5-f218ce0e9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Volume b35ed8e0-35d5-44d2-ad35-6552f8dd3531: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531', 'volume_size': 1, 'snapshot_id': '69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f'} Jul 10 19:58:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:24 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d" returned: 0 in 0.720s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.349s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-quobyte-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" by "_create_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1229f5e4-b6cd-4dec-a5ee-0e16df7085c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e606be-304d-41a6-9ffd-806fb32ad55d', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c709bb03-0b2f-4c96-b090-7a426150cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Creating volume b35ed8e0-35d5-44d2-ad35-6552f8dd3531 from snapshot 69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-quobyte-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" by "_copy_volume_from_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:24 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Volume volume-a4e606be-304d-41a6-9ffd-806fb32ad55d (a4e606be-304d-41a6-9ffd-806fb32ad55d): created successfully Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c709bb03-0b2f-4c96-b090-7a426150cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (f23ce57b-9f21-47a3-a26d-dac22e8ebbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] snapshot: 69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f, volume: b35ed8e0-35d5-44d2-ad35-6552f8dd3531, {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 19:58:24 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-df055a98-4f6c-4853-8232-6b4895559922 tempest-ProjectReaderTests-1298506470 None] Created volume successfully. Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[16609325-d49a-40e4-a058-11bd755290c9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:24 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-470b0b29-db20-4199-8000-8cb37359afd4" returned: 0 in 0.679s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-470b0b29-db20-4199-8000-8cb37359afd4" released by "delete_volume" :: held 1.632s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:24 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f Jul 10 19:58:24 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Created reservations ['b642701c-cbb9-4361-9898-61c08c180fc9', 'cb841624-c6c5-4e38-8b46-0412f9490f38', 'd515a654-19b6-4d99-9ae7-719173c5fba3', '1a3cbd70-0c99-4a05-a683-4567360898f7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:24 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:24 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:25 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" returned: 0 in 0.852s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Creating direct copy from snapshot {{(pid=87164) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[270f6198-6754-4bf6-bb93-117a5b575b16]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:25 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.742s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:25 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:25 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-9c0f9da6-41bf-4adf-b4bc-3218894067ad tempest-ProjectMemberTests-1394297638 None] Lock "cinder-470b0b29-db20-4199-8000-8cb37359afd4-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (1760b23e-ae6b-498f-bdcb-452eaa69f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e50ee28-bf42-401f-8df8-39cfd9216591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e50ee28-bf42-401f-8df8-39cfd9216591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555572229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2b0af8-b601-4845-b55c-9ec90241e7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:25Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b98f328-4646-4362-acfd-9f4cc13cc62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b98f328-4646-4362-acfd-9f4cc13cc62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c5202d-3992-41b5-a8bb-f830377b532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c5202d-3992-41b5-a8bb-f830377b532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2b0af8-b601-4845-b55c-9ec90241e7ff', 'volume_name': 'volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87bb752-acd6-47a9-9adf-705dd259cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87bb752-acd6-47a9-9adf-705dd259cef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a22e9c-75ed-4d75-875a-3b10aabc88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:25 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Volume 5c2b0af8-b601-4845-b55c-9ec90241e7ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff', 'volume_size': 1} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:25 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG cinder.utils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Path /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 not found in is_blk_device check {{(pid=87164) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 19:58:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:26 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 Jul 10 19:58:26 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:30 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" returned: 0 in 4.628s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0f7f21-a292-40ad-b6d9-8dad288c3736]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:30 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:30 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:31 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.952s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:31 devstack cinder-volume[87164]: DEBUG cinder.image.image_utils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Image conversion details: src /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 {{(pid=87164) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 19:58:31 devstack cinder-volume[87164]: INFO cinder.image.image_utils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Converted 1024.00 MB image at 221.21 MB/s Jul 10 19:58:31 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 is being set with open permissions: ugo+rw Jul 10 19:58:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:31 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 Jul 10 19:58:31 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:32 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" returned: 0 in 0.634s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" released by "_copy_volume_from_snapshot" :: held 7.973s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" released by "_create_volume_from_snapshot" :: held 8.021s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.060s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.421s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Creating offline snapshot 8e5dcbae-0a20-4a81-9994-ec1af0c9c38e of volume a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51985bf-bc10-461d-9cc5-f218ce0e9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531', 'volume_size': 1, 'snapshot_id': '69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f'}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a80c90b-244a-43fc-b252-0a32d1eb6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca7d528-f604-4f6b-93c0-5bf671e3f1a3]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:32 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Volume volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 (b35ed8e0-35d5-44d2-ad35-6552f8dd3531): created successfully Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a80c90b-244a-43fc-b252-0a32d1eb6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:32 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Flow 'volume_create_manager' (51e9338d-5af1-41c2-8ad0-c9521abcbbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-216bc61a-1c03-4e06-9e9e-da0647394419 tempest-SnapshotDependencyTests-103665677 None] Created volume successfully. Jul 10 19:58:32 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d Jul 10 19:58:32 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:33 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d" returned: 0 in 0.768s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:33 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e 1G Jul 10 19:58:33 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-quobyte-c7ab8a57-dabf-4000-8e79-318ec5eecf00" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-c7ab8a57-dabf-4000-8e79-318ec5eecf00" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-quobyte-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Deleting offline snapshot 69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f of volume c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] snapshot_file for this snap is: volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee82cd6-473c-48c1-8b20-f13185508375]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:33 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f Jul 10 19:58:33 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:33 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e 1G" returned: 0 in 0.825s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e606be-304d-41a6-9ffd-806fb32ad55d -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:33 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e606be-304d-41a6-9ffd-806fb32ad55d -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e Jul 10 19:58:33 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:34 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" returned: 0 in 0.765s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:34 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:34 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ebddf-d064-40b1-8672-83feb070c0a7]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:34 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:34 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:34 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e606be-304d-41a6-9ffd-806fb32ad55d -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" returned: 0 in 0.743s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:34 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e is being set with open permissions: ugo+rw Jul 10 19:58:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:34 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e Jul 10 19:58:34 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:35 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.783s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:35 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f Jul 10 19:58:35 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:35 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:35 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info Jul 10 19:58:35 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:35 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" returned: 0 in 0.745s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:35 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f Jul 10 19:58:35 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:35 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info" returned: 0 in 0.661s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:35 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info is being set with open permissions: ugo+rw Jul 10 19:58:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:36 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info Jul 10 19:58:36 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:36 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00.69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" returned: 0 in 0.643s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f" released by "_delete_snapshot" :: held 3.027s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-c7ab8a57-dabf-4000-8e79-318ec5eecf00" released by "delete_snapshot" :: held 3.051s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:36 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.info" returned: 0 in 0.663s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.157s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555572229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2b0af8-b601-4845-b55c-9ec90241e7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:25Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Creating volume 5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:36 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:36 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff 1073741824 Jul 10 19:58:36 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-084f906f-8676-4747-81da-563b8cf34f74 tempest-ProjectReaderTests-1298506470 None] Create snapshot completed successfully Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Created reservations ['87489c55-c2b0-4b4f-a2a1-dce4ed93e8ed', '14a82e62-8fb3-4e7a-9ace-08513b08c656', '09618f1a-bd2f-4d98-85cd-c75d1e06da1b', 'ec2936c8-4c4d-4b61-a416-55e38573b048'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Delete snapshot completed successfully. Jul 10 19:58:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-49a13184-5441-4c17-8144-de2c6bdec3bf tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-69a1b6d2-89e9-4e83-9e61-c9e3ef8e299f-delete_snapshot" released by "delete_snapshot" :: held 3.251s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-8e5dcbae-0a20-4a81-9994-ec1af0c9c38e-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-8e5dcbae-0a20-4a81-9994-ec1af0c9c38e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-a4e606be-304d-41a6-9ffd-806fb32ad55d" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-a4e606be-304d-41a6-9ffd-806fb32ad55d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Deleting offline snapshot 8e5dcbae-0a20-4a81-9994-ec1af0c9c38e of volume a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] snapshot_file for this snap is: volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cdb8ed-bdbc-4ead-96bc-bc3d36f7ef48]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:37 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff 1073741824" returned: 0 in 0.888s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:37 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:37 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:37 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e Jul 10 19:58:37 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:37 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff Jul 10 19:58:37 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-c7ab8a57-dabf-4000-8e79-318ec5eecf00-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-c7ab8a57-dabf-4000-8e79-318ec5eecf00-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-quobyte-c7ab8a57-dabf-4000-8e79-318ec5eecf00" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-c7ab8a57-dabf-4000-8e79-318ec5eecf00" acquired by "delete_volume" :: waited 0.024s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a051ad4-97d8-4d21-b029-bfe25dba3117]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:38 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:38 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:38 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.687s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:58:38 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff" returned: 0 in 0.751s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a22e9c-75ed-4d75-875a-3b10aabc88e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e52f548-91dc-4f9a-8b21-e1ed5fdeb161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:38 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Volume volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff (5c2b0af8-b601-4845-b55c-9ec90241e7ff): created successfully Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e52f548-91dc-4f9a-8b21-e1ed5fdeb161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (1760b23e-ae6b-498f-bdcb-452eaa69f048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-899a999e-6e1f-41ed-876d-529b94ef887d tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:58:38 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" returned: 0 in 0.925s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4e606be-304d-41a6-9ffd-806fb32ad55d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61398e0-a889-4b89-944e-2f8aa77c351a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:38 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d Jul 10 19:58:38 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:38 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.848s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:38 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00 Jul 10 19:58:38 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:39 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d" returned: 0 in 0.766s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:39 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e Jul 10 19:58:39 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:39 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-c7ab8a57-dabf-4000-8e79-318ec5eecf00" returned: 0 in 0.666s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-c7ab8a57-dabf-4000-8e79-318ec5eecf00" released by "delete_volume" :: held 1.580s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Created reservations ['70bfa03b-9880-488d-8ed9-60944a60b8c0', 'de47fb96-546d-4e0e-9c37-0189e33080f4', '014825c0-59b2-4c8f-b189-274e70c38cf4', 'e1e4bb2d-838d-44b0-8157-9e5e87f5879c'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:39 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:39 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 1af87984-d44f-4429-b0ce-6bbaf25f4467 of volume 5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6300169e-33b1-4c7b-ac2c-74857cf66e55]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:39 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff Jul 10 19:58:39 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-b35ed8e0-35d5-44d2-ad35-6552f8dd3531-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:40 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" returned: 0 in 0.781s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-b35ed8e0-35d5-44d2-ad35-6552f8dd3531-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:40 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e Jul 10 19:58:40 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "cinder-quobyte-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837ff5e-e5fe-44ca-a9ce-5c48b2f97091]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:40 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 Jul 10 19:58:40 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:40 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.724s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Deleted volume successfully. Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-b428f9fe-fa21-4f91-bd6d-2abee326606d tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-c7ab8a57-dabf-4000-8e79-318ec5eecf00-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:40 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff" returned: 0 in 0.971s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:40 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 1G Jul 10 19:58:40 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:40 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d.8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" returned: 0 in 0.759s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-8e5dcbae-0a20-4a81-9994-ec1af0c9c38e" released by "_delete_snapshot" :: held 3.340s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-a4e606be-304d-41a6-9ffd-806fb32ad55d" released by "delete_snapshot" :: held 3.367s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Created reservations ['aae661d4-6196-4b1e-979c-f451361c3e70', 'a04b2fbb-3fa2-4e88-9ee1-784359bd26a0', '927766ab-c807-4af0-8f6c-91dd995787fb', '520a2f0a-3fab-4289-a924-3d91b68aaaf9'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:40 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Delete snapshot completed successfully. Jul 10 19:58:40 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-6cc1ff54-c9f4-4930-879b-97bf33cc76e1 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-8e5dcbae-0a20-4a81-9994-ec1af0c9c38e-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:41 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" returned: 0 in 0.860s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:41 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531 Jul 10 19:58:41 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:41 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 1G" returned: 0 in 0.826s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:41 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 Jul 10 19:58:41 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-a4e606be-304d-41a6-9ffd-806fb32ad55d-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-a4e606be-304d-41a6-9ffd-806fb32ad55d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:41 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-quobyte-b35ed8e0-35d5-44d2-ad35-6552f8dd3531" released by "delete_volume" :: held 1.603s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-a4e606be-304d-41a6-9ffd-806fb32ad55d" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-a4e606be-304d-41a6-9ffd-806fb32ad55d" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f35410-549e-478b-841b-b9dd565d663f]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Created reservations ['e3b4e9ee-9c44-48e7-996e-3a8a6d73a203', '98da14a9-335f-448d-b5fa-2a77a5014379', '5425cb43-ce75-4373-b96e-64b78f3645e1', '9e3e78d0-5daa-44a4-b390-aa3cbfe8532b'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:41 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d Jul 10 19:58:41 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:41 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:41 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:42 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:42 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 is being set with open permissions: ugo+rw Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:42 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 Jul 10 19:58:42 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:42 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.707s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:42 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Deleted volume successfully. Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0a34e739-2ff7-4d5b-b6ce-79fc3e4071e8 tempest-SnapshotDependencyTests-103665677 None] Lock "cinder-b35ed8e0-35d5-44d2-ad35-6552f8dd3531-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:42 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d" returned: 0 in 0.878s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:42 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d Jul 10 19:58:42 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:43 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467" returned: 0 in 0.738s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:43 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info Jul 10 19:58:43 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:43 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-a4e606be-304d-41a6-9ffd-806fb32ad55d" returned: 0 in 0.702s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-a4e606be-304d-41a6-9ffd-806fb32ad55d" released by "delete_volume" :: held 1.645s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Created reservations ['c68f5158-4c3c-4ffc-8103-57697fced19f', '0199cd77-04cd-4f58-b400-2120c9a5f17f', '6bc376de-3414-4859-930b-560790dd1414', 'e427a56c-d5e2-491e-b156-4f6f2dffb883'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:43 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:43 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:43 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info" returned: 0 in 0.720s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:43 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info is being set with open permissions: ugo+rw Jul 10 19:58:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:43 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info Jul 10 19:58:43 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:44 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.810s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Deleted volume successfully. Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-5b2b6493-d9c9-484d-8df6-e2509b210618 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-a4e606be-304d-41a6-9ffd-806fb32ad55d-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (6d3663cd-2bdb-4847-8ade-3f072be8a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ddecea-8e76-4a5d-9e12-35d9f832302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ddecea-8e76-4a5d-9e12-35d9f832302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1893660525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b29c2d3-deb4-45ad-9584-440533aae1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:44Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff36688-d647-449a-8481-a21a40fdef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff36688-d647-449a-8481-a21a40fdef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0206a3e5-3988-4614-b3af-2bcabd738f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0206a3e5-3988-4614-b3af-2bcabd738f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b29c2d3-deb4-45ad-9584-440533aae1b8', 'volume_name': 'volume-3b29c2d3-deb4-45ad-9584-440533aae1b8', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1825d0-dcc9-44f6-9c0a-e4be37a3e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1825d0-dcc9-44f6-9c0a-e4be37a3e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443d0849-63eb-4d55-8457-b089d5ac0d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:44 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Volume 3b29c2d3-deb4-45ad-9584-440533aae1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b29c2d3-deb4-45ad-9584-440533aae1b8', 'volume_size': 1} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:44 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.info" returned: 0 in 0.780s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.903s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1893660525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b29c2d3-deb4-45ad-9584-440533aae1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:44Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Creating volume 3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:44 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:44 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 1073741824 Jul 10 19:58:44 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:44 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-13bd94ac-8fee-479d-b830-4b7ec9a56bb9 tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-1af87984-d44f-4429-b0ce-6bbaf25f4467-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Lock "cinder-1af87984-d44f-4429-b0ce-6bbaf25f4467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:44 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-5c2b0af8-b601-4845-b55c-9ec90241e7ff" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-5c2b0af8-b601-4845-b55c-9ec90241e7ff" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-1af87984-d44f-4429-b0ce-6bbaf25f4467" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-1af87984-d44f-4429-b0ce-6bbaf25f4467" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 1af87984-d44f-4429-b0ce-6bbaf25f4467 of volume 5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d7af3-da46-4f09-87d3-f045905657e6]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:45 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 Jul 10 19:58:45 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:45 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 1073741824" returned: 0 in 1.054s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:45 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 Jul 10 19:58:45 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:45 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467" returned: 0 in 0.881s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4692f3f0-3dff-41ff-bf99-7a71a15c8fae]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:46 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff Jul 10 19:58:46 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:46 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8" returned: 0 in 0.850s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443d0849-63eb-4d55-8457-b089d5ac0d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b29c2d3-deb4-45ad-9584-440533aae1b8', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69768a9-ac8a-4405-bd0a-96bb32f56050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:46 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Volume volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 (3b29c2d3-deb4-45ad-9584-440533aae1b8): created successfully Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69768a9-ac8a-4405-bd0a-96bb32f56050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (6d3663cd-2bdb-4847-8ade-3f072be8a967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:46 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d308047a-72a5-45b5-943f-aebec039bb4a tempest-ProjectReaderTests-1298506470 None] Created volume successfully. Jul 10 19:58:46 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff" returned: 0 in 0.890s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:46 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 Jul 10 19:58:46 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:47 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467" returned: 0 in 0.853s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:47 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467 Jul 10 19:58:47 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Creating offline snapshot 13a03813-2587-4ad6-9324-f4405c8b0edf of volume 3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88ceec-b1a9-4892-b85a-f5777de62335]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:47 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 Jul 10 19:58:47 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:48 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff.1af87984-d44f-4429-b0ce-6bbaf25f4467" returned: 0 in 0.709s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-1af87984-d44f-4429-b0ce-6bbaf25f4467" released by "_delete_snapshot" :: held 3.443s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-5c2b0af8-b601-4845-b55c-9ec90241e7ff" released by "delete_snapshot" :: held 3.476s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Created reservations ['1eb430f0-a6ea-4db2-ac72-471bbecff08b', 'eaf7baf5-0b8d-474d-b972-cfab17bbe988', '0277e809-77f5-4cdf-afc2-20a3e04aa9bb', '8eff93c2-0de4-46c7-bb35-c0b547789ad7'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:48 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-cea4258b-e687-44b8-a7e2-7dbcbf689cba tempest-ProjectMemberTests-1394297638 None] Lock "cinder-1af87984-d44f-4429-b0ce-6bbaf25f4467-delete_snapshot" released by "delete_snapshot" :: held 3.672s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:48 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8" returned: 0 in 0.864s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:48 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf 1G Jul 10 19:58:48 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-5c2b0af8-b601-4845-b55c-9ec90241e7ff-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Lock "cinder-5c2b0af8-b601-4845-b55c-9ec90241e7ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-5c2b0af8-b601-4845-b55c-9ec90241e7ff" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-5c2b0af8-b601-4845-b55c-9ec90241e7ff" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[405c5172-b332-49d5-b59b-c8e16d2b7aa9]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:49 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff Jul 10 19:58:49 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:49 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf 1G" returned: 0 in 0.996s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:49 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf Jul 10 19:58:49 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:50 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff" returned: 0 in 0.836s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:50 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff Jul 10 19:58:50 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:50 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf" returned: 0 in 0.858s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:50 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf is being set with open permissions: ugo+rw Jul 10 19:58:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:50 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf Jul 10 19:58:50 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:50 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-5c2b0af8-b601-4845-b55c-9ec90241e7ff" returned: 0 in 0.734s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-5c2b0af8-b601-4845-b55c-9ec90241e7ff" released by "delete_volume" :: held 1.665s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Created reservations ['e1cb6f30-a7b7-49ba-9a66-47f982dde228', '73a1ba9a-bccb-4604-8439-dcebf4fb792a', 'c64977dd-9d09-4fa6-bc85-5246938a679b', '8cc400b2-ad05-4bb6-aca4-b07b2a527b7f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:51 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:51 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:51 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf" returned: 0 in 0.708s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:51 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info Jul 10 19:58:51 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:51 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.796s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:51 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:58:51 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59a2874e-cb83-4b1a-bb50-ece7e470e54e tempest-ProjectMemberTests-1394297638 None] Lock "cinder-5c2b0af8-b601-4845-b55c-9ec90241e7ff-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:52 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:52 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info is being set with open permissions: ugo+rw Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:52 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info Jul 10 19:58:52 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (4096fd61-7a62-4fc9-8f83-5cc0788ddada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eec5611-680a-4a78-96c7-fe2773d4eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eec5611-680a-4a78-96c7-fe2773d4eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039196068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69119954-6fbc-441a-bcff-946142c96726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:52Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6042d3db-ef12-417b-8c01-a64128fb8aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6042d3db-ef12-417b-8c01-a64128fb8aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c4926b-b155-4385-898e-5453980499a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c4926b-b155-4385-898e-5453980499a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69119954-6fbc-441a-bcff-946142c96726', 'volume_name': 'volume-69119954-6fbc-441a-bcff-946142c96726', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6526f51-b902-4f48-a48e-63597bd3f8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6526f51-b902-4f48-a48e-63597bd3f8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d753cb64-f65d-43d0-9355-e2de8ffbe3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Volume 69119954-6fbc-441a-bcff-946142c96726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69119954-6fbc-441a-bcff-946142c96726', 'volume_size': 1} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:52 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.info" returned: 0 in 0.649s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.969s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039196068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69119954-6fbc-441a-bcff-946142c96726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:58:52Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Creating volume 69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:58:52 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:58:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:52 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 1073741824 Jul 10 19:58:52 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8784f45d-b970-4830-be39-33fd8e6c154a tempest-ProjectReaderTests-1298506470 None] Create snapshot completed successfully Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-13a03813-2587-4ad6-9324-f4405c8b0edf-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-13a03813-2587-4ad6-9324-f4405c8b0edf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-3b29c2d3-deb4-45ad-9584-440533aae1b8" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3b29c2d3-deb4-45ad-9584-440533aae1b8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-13a03813-2587-4ad6-9324-f4405c8b0edf" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-13a03813-2587-4ad6-9324-f4405c8b0edf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Deleting offline snapshot 13a03813-2587-4ad6-9324-f4405c8b0edf of volume 3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] snapshot_file for this snap is: volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcb0db7-340e-4b73-b5f0-467705d6a074]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:53 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf Jul 10 19:58:53 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:53 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 1073741824" returned: 0 in 0.847s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:53 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 Jul 10 19:58:53 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:53 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b29c2d3-deb4-45ad-9584-440533aae1b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1812be85-8ee5-4f93-ab59-0c0a8a422dfc]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:54 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 Jul 10 19:58:54 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:54 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726" returned: 0 in 0.657s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d753cb64-f65d-43d0-9355-e2de8ffbe3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69119954-6fbc-441a-bcff-946142c96726', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876a9a05-be51-4bdb-8b35-2b29cc3ef9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:58:54 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Volume volume-69119954-6fbc-441a-bcff-946142c96726 (69119954-6fbc-441a-bcff-946142c96726): created successfully Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876a9a05-be51-4bdb-8b35-2b29cc3ef9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (4096fd61-7a62-4fc9-8f83-5cc0788ddada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:58:54 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-b50e6262-bae6-487e-885c-e1deefede352 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:58:54 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8" returned: 0 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:54 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf Jul 10 19:58:54 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot f3d24900-75ce-4c9b-9c6e-ba49371f9d5f of volume 69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6563ffd-10f0-4644-83ff-f06d951647e5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:55 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf" returned: 0 in 0.782s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:55 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 Jul 10 19:58:55 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:55 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf Jul 10 19:58:55 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:56 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8.13a03813-2587-4ad6-9324-f4405c8b0edf" returned: 0 in 0.640s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:56 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726" returned: 0 in 0.766s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-13a03813-2587-4ad6-9324-f4405c8b0edf" released by "_delete_snapshot" :: held 3.082s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3b29c2d3-deb4-45ad-9584-440533aae1b8" released by "delete_snapshot" :: held 3.107s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:56 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f 1G Jul 10 19:58:56 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Created reservations ['de0bca8f-520c-4ec7-9938-2bcaf60c9a1a', '2e0dfcc4-bcdf-4350-903a-3e07e6a678a8', '997c2506-1bf4-487d-930d-a00677ba60a1', '7f8d55a8-fc2d-4c29-b129-63fcca566ea5'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:56 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Delete snapshot completed successfully. Jul 10 19:58:56 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-e3b2eda2-cc15-4562-ad72-843dfe1e5f23 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-13a03813-2587-4ad6-9324-f4405c8b0edf-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:57 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f 1G" returned: 0 in 0.805s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69119954-6fbc-441a-bcff-946142c96726 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:57 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69119954-6fbc-441a-bcff-946142c96726 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f Jul 10 19:58:57 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-3b29c2d3-deb4-45ad-9584-440533aae1b8-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-3b29c2d3-deb4-45ad-9584-440533aae1b8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-3b29c2d3-deb4-45ad-9584-440533aae1b8" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3b29c2d3-deb4-45ad-9584-440533aae1b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[de06fca1-2fdc-4eb5-b614-07428780df26]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:57 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 Jul 10 19:58:57 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:57 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69119954-6fbc-441a-bcff-946142c96726 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" returned: 0 in 0.705s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:57 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f is being set with open permissions: ugo+rw Jul 10 19:58:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:57 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f Jul 10 19:58:57 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:58 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8" returned: 0 in 0.788s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:58 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8 Jul 10 19:58:58 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:58 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" returned: 0 in 0.656s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:58 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info Jul 10 19:58:58 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:58 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-3b29c2d3-deb4-45ad-9584-440533aae1b8" returned: 0 in 0.653s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-3b29c2d3-deb4-45ad-9584-440533aae1b8" released by "delete_volume" :: held 1.515s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:58 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Created reservations ['c0331200-64ed-4e0c-9f77-27926a8addb6', '5dd09943-db0e-4602-abe1-02eaeadb8af6', '15536aa1-6223-4843-9f0f-8dc3545b6233', '069f1761-a560-4f29-8c31-c58849101515'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:59 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:58:59 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:59 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info" returned: 0 in 0.665s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:59 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info is being set with open permissions: ugo+rw Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:58:59 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info Jul 10 19:58:59 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:58:59 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.689s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:58:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Deleted volume successfully. Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-d1916534-d1cf-4dc1-b949-8f43ec050470 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-3b29c2d3-deb4-45ad-9584-440533aae1b8-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:58:59 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.info" returned: 0 in 0.706s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:58:59 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-6959e6f0-92c0-4c9e-a4de-63b21fbf253e tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:58:59 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (1512a2d3-0dca-4fae-b5b7-6d9bfc9bd8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e820b897-0481-454d-a1be-e7278c0ad48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e820b897-0481-454d-a1be-e7278c0ad48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451431655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951869db-a2c3-4fa4-8e78-220ed168d50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:00Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b5274a-463e-4390-a406-63e39be7b2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b5274a-463e-4390-a406-63e39be7b2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1932aa29-f108-4265-afb4-d6b575eaeed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1932aa29-f108-4265-afb4-d6b575eaeed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951869db-a2c3-4fa4-8e78-220ed168d50f', 'volume_name': 'volume-951869db-a2c3-4fa4-8e78-220ed168d50f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86221dd9-29a8-4d6c-945e-9353a83a3f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86221dd9-29a8-4d6c-945e-9353a83a3f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d447ea-eff7-4d54-a83d-cbd83f693ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:00 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Volume 951869db-a2c3-4fa4-8e78-220ed168d50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951869db-a2c3-4fa4-8e78-220ed168d50f', 'volume_size': 1} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451431655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951869db-a2c3-4fa4-8e78-220ed168d50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:00Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Creating volume 951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:59:00 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:00 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f 1073741824 Jul 10 19:59:00 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-f3d24900-75ce-4c9b-9c6e-ba49371f9d5f-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Lock "cinder-f3d24900-75ce-4c9b-9c6e-ba49371f9d5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-69119954-6fbc-441a-bcff-946142c96726" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-69119954-6fbc-441a-bcff-946142c96726" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot f3d24900-75ce-4c9b-9c6e-ba49371f9d5f of volume 69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74e201-56c9-45bd-82b2-cba25c362209]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:00 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f Jul 10 19:59:00 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:00 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f 1073741824" returned: 0 in 0.881s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:01 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f Jul 10 19:59:01 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:01 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" returned: 0 in 0.792s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69119954-6fbc-441a-bcff-946142c96726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0689015-0b06-467e-a394-d8aade4b649b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:01 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 Jul 10 19:59:01 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:01 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f" returned: 0 in 0.680s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d447ea-eff7-4d54-a83d-cbd83f693ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951869db-a2c3-4fa4-8e78-220ed168d50f', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5058faf-b19f-4305-b647-8b89a1171faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:01 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Volume volume-951869db-a2c3-4fa4-8e78-220ed168d50f (951869db-a2c3-4fa4-8e78-220ed168d50f): created successfully Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5058faf-b19f-4305-b647-8b89a1171faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:01 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (1512a2d3-0dca-4fae-b5b7-6d9bfc9bd8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-ed08b11f-131d-4b6d-b523-1171b6c87132 tempest-ProjectReaderTests-1298506470 None] Created volume successfully. Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Creating offline snapshot 5476578e-bd99-48bd-9b16-2af82cadba2b of volume 951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12772fb-96db-4d44-8728-ca7700c45e97]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:02 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726" returned: 0 in 0.799s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:02 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f Jul 10 19:59:02 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:02 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f Jul 10 19:59:02 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:03 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f" returned: 0 in 0.787s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:03 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b 1G Jul 10 19:59:03 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:03 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" returned: 0 in 0.758s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:03 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f Jul 10 19:59:03 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:03 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726.f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-f3d24900-75ce-4c9b-9c6e-ba49371f9d5f" released by "_delete_snapshot" :: held 3.113s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-69119954-6fbc-441a-bcff-946142c96726" released by "delete_snapshot" :: held 3.137s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:03 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b 1G" returned: 0 in 0.814s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-951869db-a2c3-4fa4-8e78-220ed168d50f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:03 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-951869db-a2c3-4fa4-8e78-220ed168d50f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Created reservations ['6e57a990-0b16-4049-87b8-abe83e7fd557', 'a7aa3a36-f42d-4406-9147-27fa2908926e', 'e997d9f2-631a-4819-9a75-4cf3a8c41f7f', '89593158-1f93-49af-97fb-1f39a542811f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:03 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:03 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:59:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8603d67a-3faf-4f6b-8ca0-975e0aecb76a tempest-ProjectMemberTests-1394297638 None] Lock "cinder-f3d24900-75ce-4c9b-9c6e-ba49371f9d5f-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:04 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-951869db-a2c3-4fa4-8e78-220ed168d50f -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b" returned: 0 in 0.688s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:04 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b is being set with open permissions: ugo+rw Jul 10 19:59:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:04 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b Jul 10 19:59:04 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-69119954-6fbc-441a-bcff-946142c96726-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Lock "cinder-69119954-6fbc-441a-bcff-946142c96726-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-69119954-6fbc-441a-bcff-946142c96726" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:04 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-69119954-6fbc-441a-bcff-946142c96726" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b896439-c066-460b-ae84-24a0ee11df6b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:05 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 Jul 10 19:59:05 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:05 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b" returned: 0 in 0.674s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:05 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info Jul 10 19:59:05 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:05 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:05 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726 Jul 10 19:59:05 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:05 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info" returned: 0 in 0.653s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:05 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info is being set with open permissions: ugo+rw Jul 10 19:59:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:05 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info Jul 10 19:59:05 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:06 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-69119954-6fbc-441a-bcff-946142c96726" returned: 0 in 0.669s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-69119954-6fbc-441a-bcff-946142c96726" released by "delete_volume" :: held 1.508s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Created reservations ['5722cee0-6bac-46ed-aa1b-9ffbdfd06ea3', '8bdc78de-e310-464c-a4c2-e10942dcbbe2', '61e77df4-c9f9-418c-b04c-338d1ae05dcd', '384fe958-8c5c-4e86-8a0a-4a89f2e55dd3'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:06 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.info" returned: 0 in 0.668s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:06 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-414ca65b-5132-4306-a34d-194ade8fc8d4 tempest-ProjectReaderTests-1298506470 None] Create snapshot completed successfully Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:06 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:06 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:07 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.656s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:07 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-971445ec-5ada-4de7-9fde-eee4054e8ddf tempest-ProjectMemberTests-1394297638 None] Lock "cinder-69119954-6fbc-441a-bcff-946142c96726-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-5476578e-bd99-48bd-9b16-2af82cadba2b-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-5476578e-bd99-48bd-9b16-2af82cadba2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-951869db-a2c3-4fa4-8e78-220ed168d50f" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-951869db-a2c3-4fa4-8e78-220ed168d50f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-5476578e-bd99-48bd-9b16-2af82cadba2b" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-5476578e-bd99-48bd-9b16-2af82cadba2b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Deleting offline snapshot 5476578e-bd99-48bd-9b16-2af82cadba2b of volume 951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] snapshot_file for this snap is: volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ebb921-fd04-4502-a619-68f1b15ab71a]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (222fcd89-8b21-42b6-9c36-d43681a2a033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3803786c-68bd-4fa1-ae91-1fe97880bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3803786c-68bd-4fa1-ae91-1fe97880bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461847968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4ee5ac-9874-434a-8235-5729ebfefaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:08Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab58cc1d-f14e-4ea4-9ea4-8f5f7cce5a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab58cc1d-f14e-4ea4-9ea4-8f5f7cce5a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba917d73-936f-4dba-b14a-60b723e1b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba917d73-936f-4dba-b14a-60b723e1b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4ee5ac-9874-434a-8235-5729ebfefaf5', 'volume_name': 'volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c418e19-1aec-4528-bfd8-e18da722a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c418e19-1aec-4528-bfd8-e18da722a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:07 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b Jul 10 19:59:07 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3688db3d-298a-4521-928b-f116b4cbad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:07 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Volume 4b4ee5ac-9874-434a-8235-5729ebfefaf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5', 'volume_size': 1} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461847968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4ee5ac-9874-434a-8235-5729ebfefaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:08Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Creating volume 4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:59:07 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:59:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:07 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 1073741824 Jul 10 19:59:07 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:08 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b" returned: 0 in 0.782s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:08 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-951869db-a2c3-4fa4-8e78-220ed168d50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:08 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7007918-9c10-4363-9229-967ea3be4c55]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:08 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f Jul 10 19:59:08 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:08 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 1073741824" returned: 0 in 0.876s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:08 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 Jul 10 19:59:08 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:09 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f" returned: 0 in 0.788s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:09 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b Jul 10 19:59:09 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:09 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5" returned: 0 in 0.638s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3688db3d-298a-4521-928b-f116b4cbad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f608d741-acd8-44a4-b207-fa1a2582553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:09 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Volume volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 (4b4ee5ac-9874-434a-8235-5729ebfefaf5): created successfully Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f608d741-acd8-44a4-b207-fa1a2582553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (222fcd89-8b21-42b6-9c36-d43681a2a033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:09 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-34d7e96b-9092-4247-a1e9-431423503761 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c of volume 4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[3104547b-9ec2-4254-9c48-57480ed11fea]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:09 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b" returned: 0 in 0.789s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:10 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b Jul 10 19:59:10 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:10 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 Jul 10 19:59:10 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:10 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f.5476578e-bd99-48bd-9b16-2af82cadba2b" returned: 0 in 0.662s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:10 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-5476578e-bd99-48bd-9b16-2af82cadba2b" released by "_delete_snapshot" :: held 3.123s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5" returned: 0 in 0.772s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-951869db-a2c3-4fa4-8e78-220ed168d50f" released by "delete_snapshot" :: held 3.159s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:10 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c 1G Jul 10 19:59:10 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Created reservations ['aeacacf3-69e1-4a89-a7a4-a68f0d42b21c', '4e80eafe-ff86-474f-be22-8bae492e3748', 'fb72b44e-cdfb-4197-b4ee-f09a1d6c7a4e', 'df983ae9-5df8-4022-95e7-3693fc218297'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Delete snapshot completed successfully. Jul 10 19:59:10 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-13a130dd-8733-4899-a616-9d6c843eddd7 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-5476578e-bd99-48bd-9b16-2af82cadba2b-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:11 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c 1G" returned: 0 in 0.792s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:11 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c Jul 10 19:59:11 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-951869db-a2c3-4fa4-8e78-220ed168d50f-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-951869db-a2c3-4fa4-8e78-220ed168d50f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-951869db-a2c3-4fa4-8e78-220ed168d50f" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-951869db-a2c3-4fa4-8e78-220ed168d50f" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff2bfef-54ed-4641-bf48-287ad757c617]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:12 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f Jul 10 19:59:12 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:12 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" returned: 0 in 0.680s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:12 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c is being set with open permissions: ugo+rw Jul 10 19:59:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:12 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c Jul 10 19:59:12 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:12 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f" returned: 0 in 0.766s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:12 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f Jul 10 19:59:12 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:12 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" returned: 0 in 0.690s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:12 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info Jul 10 19:59:12 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:13 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-951869db-a2c3-4fa4-8e78-220ed168d50f" returned: 0 in 0.649s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-951869db-a2c3-4fa4-8e78-220ed168d50f" released by "delete_volume" :: held 1.483s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Created reservations ['ebe1c606-0cb5-4fd2-bc8e-92902d0308aa', '121e6232-7dc1-48d1-a807-e6573b1bfb9d', '14f7d0a2-2a4d-47d8-9333-d1d14c775022', 'c5808be8-0464-4661-9f57-bd5f61247124'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:13 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:13 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:13 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info" returned: 0 in 0.689s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:13 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info is being set with open permissions: ugo+rw Jul 10 19:59:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:13 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info Jul 10 19:59:13 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:14 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.682s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Deleted volume successfully. Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-44c22cfd-2eda-48f3-ae13-03c4df9f04a5 tempest-ProjectReaderTests-1298506470 None] Lock "cinder-951869db-a2c3-4fa4-8e78-220ed168d50f-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:14 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.info" returned: 0 in 0.693s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.418s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9750d5e7-3a39-4aca-a96a-4c129a92e4a2 tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (400ac3fc-1bb0-4cb1-9044-18d644205afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2711e5-6075-4008-933e-df7a638885ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2711e5-6075-4008-933e-df7a638885ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598121949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77050fb-56af-436c-b61f-365ba4280ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:14Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e601b8d-f96b-415a-aa2e-1764225ae6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e601b8d-f96b-415a-aa2e-1764225ae6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3b12f6-ad7a-4f83-b9e5-0804d275326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3b12f6-ad7a-4f83-b9e5-0804d275326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77050fb-56af-436c-b61f-365ba4280ffb', 'volume_name': 'volume-b77050fb-56af-436c-b61f-365ba4280ffb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3dbc64-87a5-4e90-91c5-8d4d178aec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3dbc64-87a5-4e90-91c5-8d4d178aec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0668f029-56b2-408e-bc03-c57882a974cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:14 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Volume b77050fb-56af-436c-b61f-365ba4280ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77050fb-56af-436c-b61f-365ba4280ffb', 'volume_size': 1} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598121949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77050fb-56af-436c-b61f-365ba4280ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c17d63fd3c4d31818e0b17ca0c1c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:14Z,use_quota=True,user_id='bba0ef1767074cc8a0b0c18c3d0352ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Creating volume b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:59:14 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:59:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:14 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb 1073741824 Jul 10 19:59:14 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-4b4ee5ac-9874-434a-8235-5729ebfefaf5" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-4b4ee5ac-9874-434a-8235-5729ebfefaf5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c of volume 4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f4f463-5d32-445d-bcd4-d74e1c3f2466]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:15 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c Jul 10 19:59:15 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:15 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb 1073741824" returned: 0 in 0.857s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:15 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb Jul 10 19:59:15 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:15 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" returned: 0 in 0.776s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:15 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4591e38-704c-4253-b386-8b7f57a83c60]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:16 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 Jul 10 19:59:16 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:16 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb" returned: 0 in 0.673s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=115,cinder:INSERT=37,cinder:UPDATE=143,cinder:DELETE=10 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0668f029-56b2-408e-bc03-c57882a974cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77050fb-56af-436c-b61f-365ba4280ffb', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615c40bb-c50b-4d39-b91c-1ffb31a4ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=145,cinder:INSERT=42,cinder:SELECT=114,cinder:DELETE=14 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 19:59:16 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Volume volume-b77050fb-56af-436c-b61f-365ba4280ffb (b77050fb-56af-436c-b61f-365ba4280ffb): created successfully Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615c40bb-c50b-4d39-b91c-1ffb31a4ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Flow 'volume_create_manager' (400ac3fc-1bb0-4cb1-9044-18d644205afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:16 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3b0fc172-db60-40b1-aa89-f71f30465329 tempest-ProjectReaderTests-1298506470 None] Created volume successfully. Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Creating offline snapshot bdfbaa68-98be-4566-acba-977989325610 of volume b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6027c59-b8ed-43f7-8a35-4b69d6b823b0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:16 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5" returned: 0 in 0.798s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:16 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c Jul 10 19:59:16 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:16 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb Jul 10 19:59:16 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:17 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" returned: 0 in 0.738s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:17 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:17 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c Jul 10 19:59:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb" returned: 0 in 0.785s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:17 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:17 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 1G Jul 10 19:59:17 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:18 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5.1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" returned: 0 in 0.666s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c" released by "_delete_snapshot" :: held 3.069s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-4b4ee5ac-9874-434a-8235-5729ebfefaf5" released by "delete_snapshot" :: held 3.099s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Created reservations ['42966ff5-427d-4010-9b90-77eadc4ed754', '2b159876-9a46-4f5f-a51e-82b5fb72c030', 'a62fafdc-9606-4081-a258-24eeffee68f0', 'd79000eb-a72a-46a6-b5eb-8042c6d70ef4'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:18 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-aa60a2e0-6439-4b7b-8530-e18d192e8831 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-1b2e9b30-ec98-4a18-9156-b3b18ad0cd0c-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:18 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 1G" returned: 0 in 0.834s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:18 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77050fb-56af-436c-b61f-365ba4280ffb -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:18 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77050fb-56af-436c-b61f-365ba4280ffb -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 Jul 10 19:59:18 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:19 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77050fb-56af-436c-b61f-365ba4280ffb -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:19 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 is being set with open permissions: ugo+rw Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:19 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 Jul 10 19:59:19 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-4b4ee5ac-9874-434a-8235-5729ebfefaf5-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-4b4ee5ac-9874-434a-8235-5729ebfefaf5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-4b4ee5ac-9874-434a-8235-5729ebfefaf5" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-4b4ee5ac-9874-434a-8235-5729ebfefaf5" acquired by "delete_volume" :: waited 0.021s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd734ca-3922-4e25-b828-32ac2db2d899]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:19 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 Jul 10 19:59:19 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:19 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610" returned: 0 in 0.728s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:19 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:19 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info Jul 10 19:59:19 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:20 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5" returned: 0 in 0.790s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:20 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5 Jul 10 19:59:20 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:20 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info" returned: 0 in 0.675s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:20 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info is being set with open permissions: ugo+rw Jul 10 19:59:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:20 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info Jul 10 19:59:20 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:20 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:20 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-4b4ee5ac-9874-434a-8235-5729ebfefaf5" returned: 0 in 0.663s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-4b4ee5ac-9874-434a-8235-5729ebfefaf5" released by "delete_volume" :: held 1.520s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Created reservations ['3b74ba6f-58b0-48ff-8786-a9aa51afa9cd', '206ee5ea-c317-44d0-9313-f565954e884d', '1a630477-8b6a-4f6d-8697-508c82a9f12a', '185fe436-4a14-4bc0-96d6-3dd90fecca75'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:21 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:21 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:21 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.info" returned: 0 in 0.669s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.466s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-3261cfe3-c42f-4cb5-96d6-1c6a7e6f3571 tempest-ProjectReaderTests-1298506470 None] Create snapshot completed successfully Jul 10 19:59:21 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:21 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-12b0a368-4ca5-4994-a8a4-590ee64a6f27 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-4b4ee5ac-9874-434a-8235-5729ebfefaf5-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:21 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-bdfbaa68-98be-4566-acba-977989325610-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Lock "cinder-bdfbaa68-98be-4566-acba-977989325610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-b77050fb-56af-436c-b61f-365ba4280ffb" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-b77050fb-56af-436c-b61f-365ba4280ffb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-bdfbaa68-98be-4566-acba-977989325610" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-bdfbaa68-98be-4566-acba-977989325610" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Deleting offline snapshot bdfbaa68-98be-4566-acba-977989325610 of volume b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] snapshot_file for this snap is: volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44dfc2e-8ed7-40ef-997a-bad93fd6a515]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (e6fe80d5-7fe5-4310-b27e-a46caea1510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3400243e-2020-4277-95fd-c19b7958e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3400243e-2020-4277-95fd-c19b7958e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325491211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cc5b89-6611-477a-babc-dc7bb1dae546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:22Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27915fe6-5fa6-491d-b5f6-8a41675916dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27915fe6-5fa6-491d-b5f6-8a41675916dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3400428f-7ca5-49f0-a9f9-323f2d58e8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3400428f-7ca5-49f0-a9f9-323f2d58e8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34cc5b89-6611-477a-babc-dc7bb1dae546', 'volume_name': 'volume-34cc5b89-6611-477a-babc-dc7bb1dae546', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337bc965-049c-40c2-8eaf-00df5d1d12b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337bc965-049c-40c2-8eaf-00df5d1d12b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5262f3-6dc9-4fec-8f6a-680aeb06332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:22 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Volume 34cc5b89-6611-477a-babc-dc7bb1dae546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34cc5b89-6611-477a-babc-dc7bb1dae546', 'volume_size': 1} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325491211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cc5b89-6611-477a-babc-dc7bb1dae546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:22Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Creating volume 34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:22 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 Jul 10 19:59:22 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:59:22 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:22 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 1073741824 Jul 10 19:59:22 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:22 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610" returned: 0 in 0.760s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77050fb-56af-436c-b61f-365ba4280ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab820a9-863f-41d2-80b0-484989529ec5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:22 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:23 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb Jul 10 19:59:23 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:23 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 1073741824" returned: 0 in 0.822s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:23 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 Jul 10 19:59:23 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:23 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb" returned: 0 in 0.771s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:23 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 Jul 10 19:59:23 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:23 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546" returned: 0 in 0.677s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5262f3-6dc9-4fec-8f6a-680aeb06332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34cc5b89-6611-477a-babc-dc7bb1dae546', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50432c76-3835-48e1-8afc-01acfd1c6d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:23 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Volume volume-34cc5b89-6611-477a-babc-dc7bb1dae546 (34cc5b89-6611-477a-babc-dc7bb1dae546): created successfully Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50432c76-3835-48e1-8afc-01acfd1c6d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:23 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (e6fe80d5-7fe5-4310-b27e-a46caea1510f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:23 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-387bb8a5-925e-4803-92e5-b8947e523865 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 4e633f7d-798e-4120-9bc9-c42bf6b3d15e of volume 34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6033f92-1293-41a2-8c37-f3853b72477e]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:24 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 Jul 10 19:59:24 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:24 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610" returned: 0 in 0.789s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:24 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:24 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610 Jul 10 19:59:24 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:25 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546" returned: 0 in 0.767s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:25 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb.bdfbaa68-98be-4566-acba-977989325610" returned: 0 in 0.655s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:25 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e 1G Jul 10 19:59:25 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-bdfbaa68-98be-4566-acba-977989325610" released by "_delete_snapshot" :: held 3.084s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-b77050fb-56af-436c-b61f-365ba4280ffb" released by "delete_snapshot" :: held 3.109s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Created reservations ['8629237d-bd64-4676-8498-728c745532ea', '8d0e7817-d887-426b-bb40-928cf63b9ed7', '51a03322-c908-44f5-9637-b312c9fb4a13', '4abcabd4-9bbe-4602-a9c2-412bf919a62f'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:25 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Delete snapshot completed successfully. Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-550dc426-34bc-4e7e-8f05-33af097832cf tempest-ProjectReaderTests-1298506470 None] Lock "cinder-bdfbaa68-98be-4566-acba-977989325610-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:25 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e 1G" returned: 0 in 0.800s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:25 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cc5b89-6611-477a-babc-dc7bb1dae546 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:25 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cc5b89-6611-477a-babc-dc7bb1dae546 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e Jul 10 19:59:25 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-b77050fb-56af-436c-b61f-365ba4280ffb-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Lock "cinder-b77050fb-56af-436c-b61f-365ba4280ffb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Acquiring lock "cinder-quobyte-b77050fb-56af-436c-b61f-365ba4280ffb" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-b77050fb-56af-436c-b61f-365ba4280ffb" acquired by "delete_volume" :: waited 0.030s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[296883c1-4fad-4881-bc05-165625182ae0]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:26 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb Jul 10 19:59:26 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:26 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cc5b89-6611-477a-babc-dc7bb1dae546 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e" returned: 0 in 0.721s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:26 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e is being set with open permissions: ugo+rw Jul 10 19:59:26 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:26 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e Jul 10 19:59:26 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:27 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb" returned: 0 in 0.803s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:27 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb Jul 10 19:59:27 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:27 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e" returned: 0 in 0.672s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:27 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info Jul 10 19:59:27 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:27 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-b77050fb-56af-436c-b61f-365ba4280ffb" returned: 0 in 0.714s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Lock "cinder-quobyte-b77050fb-56af-436c-b61f-365ba4280ffb" released by "delete_volume" :: held 1.585s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:27 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Created reservations ['fa654da5-4f9c-46d0-aace-99db9f29ce42', '0a656b11-8d0e-44f7-99d4-1d1e5c7c7b79', '2b27fcc8-e323-4c96-8948-df489d56ebcd', '6acfcfb1-4e63-42af-8b58-8539d8bc021a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:28 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info" returned: 0 in 0.684s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:28 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info is being set with open permissions: ugo+rw Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:28 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info Jul 10 19:59:28 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:28 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:28 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:28 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.info" returned: 0 in 0.691s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:28 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.682s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Deleted volume successfully. Jul 10 19:59:28 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1cdacd5a-cc52-4f10-8dde-19ff2a01026c tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:59:28 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-dc87f280-c2b1-4aed-a86a-4c8c0e578b2d tempest-ProjectReaderTests-1298506470 None] Lock "cinder-b77050fb-56af-436c-b61f-365ba4280ffb-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-4e633f7d-798e-4120-9bc9-c42bf6b3d15e-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Lock "cinder-4e633f7d-798e-4120-9bc9-c42bf6b3d15e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-34cc5b89-6611-477a-babc-dc7bb1dae546" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-34cc5b89-6611-477a-babc-dc7bb1dae546" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-4e633f7d-798e-4120-9bc9-c42bf6b3d15e" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-4e633f7d-798e-4120-9bc9-c42bf6b3d15e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 4e633f7d-798e-4120-9bc9-c42bf6b3d15e of volume 34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1d5d24-2ae2-4cc4-8876-17852982b913]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:29 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:29 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e Jul 10 19:59:29 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:30 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e" returned: 0 in 0.827s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:30 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cc5b89-6611-477a-babc-dc7bb1dae546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:30 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f712e56-37e5-4f5e-b5e1-0940eab9908c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:30 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:30 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 Jul 10 19:59:30 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:31 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546" returned: 0 in 0.778s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:31 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:31 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e Jul 10 19:59:31 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:32 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e" returned: 0 in 0.734s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:32 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e Jul 10 19:59:32 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:32 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546.4e633f7d-798e-4120-9bc9-c42bf6b3d15e" returned: 0 in 0.692s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-4e633f7d-798e-4120-9bc9-c42bf6b3d15e" released by "_delete_snapshot" :: held 3.128s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-34cc5b89-6611-477a-babc-dc7bb1dae546" released by "delete_snapshot" :: held 3.150s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Created reservations ['2882bb7d-f1cf-40fb-92a2-ccda201fcf86', 'b106e42c-11f5-4dc9-b721-e1666f460b8b', '53ef3978-fff9-488d-b2be-02749230c7c4', 'd5c14d52-4560-4004-bbd0-2e1e965fe211'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:32 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:59:32 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-8c362e36-251b-4bca-b5b9-2dfffddf360f tempest-ProjectMemberTests-1394297638 None] Lock "cinder-4e633f7d-798e-4120-9bc9-c42bf6b3d15e-delete_snapshot" released by "delete_snapshot" :: held 3.296s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-34cc5b89-6611-477a-babc-dc7bb1dae546-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-34cc5b89-6611-477a-babc-dc7bb1dae546-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-34cc5b89-6611-477a-babc-dc7bb1dae546" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:33 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-34cc5b89-6611-477a-babc-dc7bb1dae546" acquired by "delete_volume" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:33 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a01e4-acdf-4d99-8698-b775e94ac298]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:33 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:33 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 Jul 10 19:59:33 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:34 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546" returned: 0 in 0.767s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:34 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:34 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546 Jul 10 19:59:34 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:35 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-34cc5b89-6611-477a-babc-dc7bb1dae546" returned: 0 in 0.710s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-34cc5b89-6611-477a-babc-dc7bb1dae546" released by "delete_volume" :: held 1.538s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Created reservations ['9f1b229c-6e78-4bc2-8a6f-e93f28b35f93', 'a4bcde4a-03f4-4b5d-92dd-b615af089c49', '6a5eea6c-57c1-4216-8731-0374975497a0', '64faa354-61ca-4710-9c89-e5762e6b5b86'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:35 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:35 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:35 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:36 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.640s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:36 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-c6e2a4d3-6e2e-4061-a7ec-31eccea2843d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-34cc5b89-6611-477a-babc-dc7bb1dae546-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (3b326904-c401-4826-9751-81f21e02d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d82ba21-f617-4cdc-9fec-8a6bcbe4d85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d82ba21-f617-4cdc-9fec-8a6bcbe4d85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017629097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0029c820-3d34-45f0-b9b3-39019a2fd5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:36Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9592d2-d70e-46b4-908e-bdd50a54eac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9592d2-d70e-46b4-908e-bdd50a54eac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc87f86-57c1-49d9-a026-369fb473c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc87f86-57c1-49d9-a026-369fb473c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0029c820-3d34-45f0-b9b3-39019a2fd5b6', 'volume_name': 'volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d357e213-b729-4393-9279-076f2517c2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d357e213-b729-4393-9279-076f2517c2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd91a33-4930-491d-bc3e-8a6a7630a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:36 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Volume 0029c820-3d34-45f0-b9b3-39019a2fd5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6', 'volume_size': 1} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017629097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0029c820-3d34-45f0-b9b3-39019a2fd5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:36Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Creating volume 0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:59:36 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:59:36 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:36 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 1073741824 Jul 10 19:59:36 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:37 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 1073741824" returned: 0 in 0.889s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:37 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 Jul 10 19:59:37 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:37 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:37 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:38 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd91a33-4930-491d-bc3e-8a6a7630a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466baf81-cd7e-45b0-989b-54002da881fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:38 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Volume volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 (0029c820-3d34-45f0-b9b3-39019a2fd5b6): created successfully Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466baf81-cd7e-45b0-989b-54002da881fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (3b326904-c401-4826-9751-81f21e02d236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:38 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-75444a37-c63f-41b2-8191-3206405caff4 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:59:38 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.698s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 91195015-2578-4b81-ba03-affa8715278d of volume 0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c04e56-9330-4eaa-9e1a-6d1dbe5ff759]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:38 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 Jul 10 19:59:38 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:39 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6" returned: 0 in 0.814s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:39 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:39 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d 1G Jul 10 19:59:39 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:40 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d 1G" returned: 0 in 0.871s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:40 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:40 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d Jul 10 19:59:40 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:41 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d" returned: 0 in 0.735s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:41 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d is being set with open permissions: ugo+rw Jul 10 19:59:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:41 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d Jul 10 19:59:41 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:41 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d" returned: 0 in 0.668s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:41 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:41 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info Jul 10 19:59:41 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:42 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info" returned: 0 in 0.671s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:42 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info is being set with open permissions: ugo+rw Jul 10 19:59:42 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:42 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info Jul 10 19:59:42 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:43 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.info" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.500s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:43 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-5cc49241-49ff-44ba-a1f7-5428fab27831 tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-91195015-2578-4b81-ba03-affa8715278d-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-91195015-2578-4b81-ba03-affa8715278d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-0029c820-3d34-45f0-b9b3-39019a2fd5b6" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-0029c820-3d34-45f0-b9b3-39019a2fd5b6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-91195015-2578-4b81-ba03-affa8715278d" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:43 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-91195015-2578-4b81-ba03-affa8715278d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 91195015-2578-4b81-ba03-affa8715278d of volume 0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[672349b8-a442-4a9b-9ce5-6e09e8e3378d]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:44 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d Jul 10 19:59:44 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:44 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d" returned: 0 in 0.806s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8212b-fc46-47b4-9b43-86666e575cbe]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:44 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:44 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 Jul 10 19:59:44 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:45 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6" returned: 0 in 0.811s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:45 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:45 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d Jul 10 19:59:45 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:46 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d" returned: 0 in 0.809s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:46 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:46 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d Jul 10 19:59:46 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:47 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:47 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6.91195015-2578-4b81-ba03-affa8715278d" returned: 0 in 0.685s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-91195015-2578-4b81-ba03-affa8715278d" released by "_delete_snapshot" :: held 3.215s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-0029c820-3d34-45f0-b9b3-39019a2fd5b6" released by "delete_snapshot" :: held 3.239s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:47 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Created reservations ['d04b1cc9-b6bd-413d-8789-f2c66cfbb943', '7bbd0d8a-cfe1-4d36-abad-405f3806cb4b', 'c22c5b1b-53fa-4ead-b2f8-871eb2a8614b', 'c6294d69-2a80-4951-a3d6-7812df23bc9a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:47 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 19:59:47 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-1d24932e-1b79-4518-b32d-2b2a33883e90 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-91195015-2578-4b81-ba03-affa8715278d-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-0029c820-3d34-45f0-b9b3-39019a2fd5b6-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-0029c820-3d34-45f0-b9b3-39019a2fd5b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-0029c820-3d34-45f0-b9b3-39019a2fd5b6" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:48 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-0029c820-3d34-45f0-b9b3-39019a2fd5b6" acquired by "delete_volume" :: waited 0.018s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:48 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a75649-3ccc-43d3-a346-13a0e857b17b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:48 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:48 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 Jul 10 19:59:48 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:49 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6" returned: 0 in 0.832s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:49 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6 Jul 10 19:59:49 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:49 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-0029c820-3d34-45f0-b9b3-39019a2fd5b6" returned: 0 in 0.667s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-0029c820-3d34-45f0-b9b3-39019a2fd5b6" released by "delete_volume" :: held 1.569s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Created reservations ['b954dcbd-2290-4341-a9ad-1bf90b6a9bb2', '6eadc31f-1f8e-4362-94d9-c2e888eb7b92', '38e7b547-6591-48e2-8665-6cb38762af18', '84b1db73-62e8-4e0f-bc9f-b959a10825b8'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:49 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:49 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 19:59:49 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:50 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.710s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 19:59:50 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-db1a2211-a01f-4116-a58f-fa373a616f5d tempest-ProjectMemberTests-1394297638 None] Lock "cinder-0029c820-3d34-45f0-b9b3-39019a2fd5b6-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (289f153b-0c09-4b27-a296-10a14827d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c883717-6853-42b5-ae94-59bc47b195a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c883717-6853-42b5-ae94-59bc47b195a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648123500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13279b91-1b7d-4a90-ac16-6d0915c41d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:51Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288bb8c9-2711-46ad-af4e-7abd8c2d0468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288bb8c9-2711-46ad-af4e-7abd8c2d0468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce42376-82d5-4c8e-a491-fdc9e4594aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce42376-82d5-4c8e-a491-fdc9e4594aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13279b91-1b7d-4a90-ac16-6d0915c41d76', 'volume_name': 'volume-13279b91-1b7d-4a90-ac16-6d0915c41d76', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c598b4-2f46-4140-bebd-532457117163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c598b4-2f46-4140-bebd-532457117163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcb5011-bd60-4a53-8ee0-236df4268a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:50 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Volume 13279b91-1b7d-4a90-ac16-6d0915c41d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13279b91-1b7d-4a90-ac16-6d0915c41d76', 'volume_size': 1} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T17:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648123500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13279b91-1b7d-4a90-ac16-6d0915c41d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T17:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T17:59:51Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Creating volume 13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 19:59:50 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 19:59:50 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:51 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 1073741824 Jul 10 19:59:51 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:51 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 1073741824" returned: 0 in 0.843s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:51 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:51 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 Jul 10 19:59:51 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:52 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76" returned: 0 in 0.648s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcb5011-bd60-4a53-8ee0-236df4268a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13279b91-1b7d-4a90-ac16-6d0915c41d76', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78801d3-0832-4c05-8f85-e31875c698fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 19:59:52 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Volume volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 (13279b91-1b7d-4a90-ac16-6d0915c41d76): created successfully Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78801d3-0832-4c05-8f85-e31875c698fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 19:59:52 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (289f153b-0c09-4b27-a296-10a14827d17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 19:59:52 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-9c81bd81-7ae5-471b-b9a5-9a8a52b6d963 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot 134aef63-ae85-46b3-9770-5e869cee7f78 of volume 13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adaff46-0751-4ec2-a231-82469a8c1a1b]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:53 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 Jul 10 19:59:53 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:53 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76" returned: 0 in 0.772s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:53 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:53 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 1G Jul 10 19:59:53 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:54 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 1G" returned: 0 in 0.794s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:54 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:54 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 Jul 10 19:59:54 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:55 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78" returned: 0 in 0.694s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:55 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 is being set with open permissions: ugo+rw Jul 10 19:59:55 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:55 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 Jul 10 19:59:55 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:56 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78" returned: 0 in 0.637s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:56 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info Jul 10 19:59:56 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:56 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info" returned: 0 in 0.652s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:56 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info is being set with open permissions: ugo+rw Jul 10 19:59:56 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:56 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info Jul 10 19:59:56 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:57 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.info" returned: 0 in 0.650s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:57 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 19:59:57 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-42b74c33-73de-4bbd-bf2d-c3cc147d136b tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-134aef63-ae85-46b3-9770-5e869cee7f78-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-134aef63-ae85-46b3-9770-5e869cee7f78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-13279b91-1b7d-4a90-ac16-6d0915c41d76" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-13279b91-1b7d-4a90-ac16-6d0915c41d76" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-134aef63-ae85-46b3-9770-5e869cee7f78" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-134aef63-ae85-46b3-9770-5e869cee7f78" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot 134aef63-ae85-46b3-9770-5e869cee7f78 of volume 13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc80b9-5931-4aee-9e3c-692bfb006c08]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:58 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:58 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 Jul 10 19:59:58 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:59 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78" returned: 0 in 0.747s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:59 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13279b91-1b7d-4a90-ac16-6d0915c41d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 19:59:59 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9237d4-7932-4e0e-b077-56064338617c]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 19:59:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:59 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 Jul 10 19:59:59 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 19:59:59 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 10 19:59:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76" returned: 0 in 0.745s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 19:59:59 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 19:59:59 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 Jul 10 19:59:59 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:00 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78" returned: 0 in 0.730s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:00 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:00 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78 Jul 10 20:00:00 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:01 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76.134aef63-ae85-46b3-9770-5e869cee7f78" returned: 0 in 0.666s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-134aef63-ae85-46b3-9770-5e869cee7f78" released by "_delete_snapshot" :: held 2.979s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-13279b91-1b7d-4a90-ac16-6d0915c41d76" released by "delete_snapshot" :: held 3.002s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Created reservations ['7e765658-9ce2-47c1-a079-e3c189d7da68', '88404057-504f-4660-857d-846841375a03', '6cbd1e8d-318f-4309-a78c-857795a7a8a3', 'c5674661-9ce2-475b-8de6-de9a22aff079'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 20:00:01 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-0015871e-acfc-4591-8472-4ab1ee5379b7 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-134aef63-ae85-46b3-9770-5e869cee7f78-delete_snapshot" released by "delete_snapshot" :: held 3.149s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-13279b91-1b7d-4a90-ac16-6d0915c41d76-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Lock "cinder-13279b91-1b7d-4a90-ac16-6d0915c41d76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-13279b91-1b7d-4a90-ac16-6d0915c41d76" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-13279b91-1b7d-4a90-ac16-6d0915c41d76" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5babe8b-d7de-4187-a33e-1339073cf2fb]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 20:00:01 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:01 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 Jul 10 20:00:01 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:02 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76" returned: 0 in 0.813s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:02 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:02 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76 Jul 10 20:00:02 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:03 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-13279b91-1b7d-4a90-ac16-6d0915c41d76" returned: 0 in 0.663s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-13279b91-1b7d-4a90-ac16-6d0915c41d76" released by "delete_volume" :: held 1.535s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Created reservations ['12256846-9ad9-4e1c-b4b0-84d2d0545d63', '6fb65144-b84a-4f55-8031-518ab9221761', 'ed80e40b-4ec2-4a13-a991-9395017b07e8', '2b8b474f-13a3-403d-8957-f79b4a0f3bc5'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:03 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 20:00:03 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:03 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.653s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 20:00:03 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 20:00:03 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-84c4041f-918a-474d-b7b2-1d04a2da7a5c tempest-ProjectMemberTests-1394297638 None] Lock "cinder-13279b91-1b7d-4a90-ac16-6d0915c41d76-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87164) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (dd07e2ef-6565-4b08-b87d-0801b7ae32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c5d606-82c8-4d02-995e-3374fe2aa14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c5d606-82c8-4d02-995e-3374fe2aa14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T18:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119758293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8186bb83-df08-4cb2-9963-11a934a3d554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T18:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T18:00:04Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241969dd-470c-4a70-8337-a4b543fdb6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241969dd-470c-4a70-8337-a4b543fdb6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a731aed-26cc-44ec-be7b-a7665c4ae820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a731aed-26cc-44ec-be7b-a7665c4ae820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8186bb83-df08-4cb2-9963-11a934a3d554', 'volume_name': 'volume-8186bb83-df08-4cb2-9963-11a934a3d554', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0f9a52-3074-4c12-9737-44a9815a9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0f9a52-3074-4c12-9737-44a9815a9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffffa22c-43fa-43f8-b42c-1c3706ef0835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 20:00:04 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Volume 8186bb83-df08-4cb2-9963-11a934a3d554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8186bb83-df08-4cb2-9963-11a934a3d554', 'volume_size': 1} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T18:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119758293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8186bb83-df08-4cb2-9963-11a934a3d554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b7b4efab61430f92454beab66e4eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T18:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T18:00:04Z,use_quota=True,user_id='d7ebdcd5ecd54bdf874ebd46cc2e6567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fb8ba8-9014-4b5f-a4d3-199b58a05c38),volume_type_id=62fb8ba8-9014-4b5f-a4d3-199b58a05c38)}" {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Creating volume 8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 as target Quobyte volume. {{(pid=87164) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 20:00:04 devstack cinder-volume[87164]: INFO cinder.volume.drivers.remotefs [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6 Jul 10 20:00:04 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 1073741824 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:04 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 1073741824 Jul 10 20:00:04 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:05 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 1073741824" returned: 0 in 0.793s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:05 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 Jul 10 20:00:05 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:05 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554" returned: 0 in 0.637s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'} {{(pid=87164) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffffa22c-43fa-43f8-b42c-1c3706ef0835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8186bb83-df08-4cb2-9963-11a934a3d554', 'volume_size': 1}' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b7887a-932f-4f40-962b-5e148fb3a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 20:00:05 devstack cinder-volume[87164]: INFO cinder.volume.flows.manager.create_volume [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Volume volume-8186bb83-df08-4cb2-9963-11a934a3d554 (8186bb83-df08-4cb2-9963-11a934a3d554): created successfully Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b7887a-932f-4f40-962b-5e148fb3a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87164) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 20:00:05 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Flow 'volume_create_manager' (dd07e2ef-6565-4b08-b87d-0801b7ae32fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87164) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 20:00:05 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-0a90613f-b769-4abe-b31b-3cd3b0e9c236 tempest-ProjectMemberTests-1394297638 None] Created volume successfully. Jul 10 20:00:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 20:00:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 20:00:06 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Creating offline snapshot bfaecf57-d89a-4825-a906-af86355a2d39 of volume 8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 20:00:06 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad5781f-070b-478e-9942-239a03a16b73]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 20:00:06 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:06 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 Jul 10 20:00:06 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:07 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554" returned: 0 in 0.752s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:07 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 1G {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:07 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 1G Jul 10 20:00:07 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:08 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 1G" returned: 0 in 0.769s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8186bb83-df08-4cb2-9963-11a934a3d554 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:08 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8186bb83-df08-4cb2-9963-11a934a3d554 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 Jul 10 20:00:08 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:08 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8186bb83-df08-4cb2-9963-11a934a3d554 -F qcow2 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39" returned: 0 in 0.666s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:08 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 is being set with open permissions: ugo+rw Jul 10 20:00:08 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:08 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 Jul 10 20:00:08 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:09 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39" returned: 0 in 0.648s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:09 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:09 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info Jul 10 20:00:09 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:10 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info" returned: 0 in 0.641s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:10 devstack cinder-volume[87164]: WARNING cinder.volume.drivers.remotefs [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info is being set with open permissions: ugo+rw Jul 10 20:00:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:10 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info Jul 10 20:00:10 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:10 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.info" returned: 0 in 0.660s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:10 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.216s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 20:00:10 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-c63b3796-30e8-439d-8519-960d9e7ac593 tempest-ProjectMemberTests-1394297638 None] Create snapshot completed successfully Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-bfaecf57-d89a-4825-a906-af86355a2d39-delete_snapshot" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Lock "cinder-bfaecf57-d89a-4825-a906-af86355a2d39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-8186bb83-df08-4cb2-9963-11a934a3d554" by "delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-8186bb83-df08-4cb2-9963-11a934a3d554" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-bfaecf57-d89a-4825-a906-af86355a2d39" by "_delete_snapshot" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-bfaecf57-d89a-4825-a906-af86355a2d39" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Deleting offline snapshot bfaecf57-d89a-4825-a906-af86355a2d39 of volume 8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] snapshot_file for this snap is: volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 {{(pid=87164) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[c146198f-d543-41c4-8ff8-2b462e482b39]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 20:00:11 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:11 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 Jul 10 20:00:11 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:12 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39" returned: 0 in 0.746s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:12 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.remotefs [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8186bb83-df08-4cb2-9963-11a934a3d554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87164) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 20:00:12 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad97f9f-a2dc-4b43-8bcb-74f2d6adb5d5]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 20:00:12 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:12 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 Jul 10 20:00:12 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:13 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554" returned: 0 in 0.729s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:13 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:13 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 Jul 10 20:00:13 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:14 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39" returned: 0 in 0.716s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:14 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39 Jul 10 20:00:14 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:14 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554.bfaecf57-d89a-4825-a906-af86355a2d39" returned: 0 in 0.638s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-bfaecf57-d89a-4825-a906-af86355a2d39" released by "_delete_snapshot" :: held 2.927s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-8186bb83-df08-4cb2-9963-11a934a3d554" released by "delete_snapshot" :: held 2.961s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Created reservations ['5088c4c5-2d97-46d0-a0e8-59fd6ef05faa', 'd3918bb4-af3a-4e3a-bdda-5f219668d5ec', 'e496008e-68d0-4c90-ad9c-08d34dbd366c', '5e847725-b01d-49a7-bd23-82b991da5298'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 20:00:14 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Delete snapshot completed successfully. Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-59b9b13d-5df5-4ded-a51d-5427a6fe84cd tempest-ProjectMemberTests-1394297638 None] Lock "cinder-bfaecf57-d89a-4825-a906-af86355a2d39-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-8186bb83-df08-4cb2-9963-11a934a3d554-delete_volume" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:14 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-8186bb83-df08-4cb2-9963-11a934a3d554-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "cinder-quobyte-8186bb83-df08-4cb2-9963-11a934a3d554" by "delete_volume" {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 20:00:15 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-8186bb83-df08-4cb2-9963-11a934a3d554" acquired by "delete_volume" :: waited 0.015s {{(pid=87164) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 20:00:15 devstack cinder-volume[87164]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc06191-ecaa-4987-a6a6-3546882f5f61]: (4, 'qcow2') {{(pid=88215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 20:00:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:15 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 Jul 10 20:00:15 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:15 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554" returned: 0 in 0.774s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:15 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:15 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554 Jul 10 20:00:15 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:16 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a/volume-8186bb83-df08-4cb2-9963-11a934a3d554" returned: 0 in 0.642s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-quobyte-8186bb83-df08-4cb2-9963-11a934a3d554" released by "delete_volume" :: held 1.472s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=97,cinder:SELECT=68,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=90,cinder:DELETE=9,cinder:SELECT=81,cinder:INSERT=28 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG cinder.quota [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Created reservations ['7754e0d3-eee8-4970-8721-0315d594f50b', '593d362b-f262-458b-af9a-28c6cb8ad8d2', '7db2eab7-05d1-41d4-a5d4-6ee5f7ed99f4', 'c2b6374e-0396-46f3-8d5b-ad02835c7a3a'] {{(pid=87164) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 20:00:16 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:16 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 20:00:16 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:17 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:17 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.720s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:17 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 20:00:17 devstack cinder-volume[87164]: INFO cinder.volume.manager [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Deleted volume successfully. Jul 10 20:00:17 devstack cinder-volume[87164]: DEBUG cinder.coordination [None req-66a3da9f-ec2b-4016-a2a5-8548ec1856c3 tempest-ProjectMemberTests-1394297638 None] Lock "cinder-8186bb83-df08-4cb2-9963-11a934a3d554-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87164) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 20:00:26 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=9,cinder:SELECT=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 20:00:27 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6': None} {{(pid=87164) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cce388-4626-48c1-96f5-5da6b66594d6'] {{(pid=87164) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.lockutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87164) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 20:00:37 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 20:00:37 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a Jul 10 20:00:37 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 20:00:38 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG oslo_concurrency.processutils [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/311705b38d810cf05319163beb33224a" returned: 0 in 0.688s {{(pid=87164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG cinder.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Notifying Schedulers of capabilities ... {{(pid=87164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG oslo_service.periodic_task [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] Running periodic task VolumeManager._thread_info {{(pid=87164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread count: 28 {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG cinder.volume.manager [None req-0d0d2ba2-37c7-433c-9d25-a9ea3204626f None None] thread info: [<_MainThread(MainThread, started 140637337583744)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:SELECT=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 20:00:38 devstack cinder-volume[87164]: DEBUG dbcounter [-] [87164] Writing DB stats cinder:UPDATE=1 {{(pid=87164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}